[==========] Running 7 tests from 2 test suites.
[----------] Global test environment set-up.
[----------] 5 tests from LeaderRebalancerTest
[ RUN ] LeaderRebalancerTest.FunctionalTestForDivided
WARNING: Logging before InitGoogleLogging() is written to STDERR
I20250109 21:09:03.639322 20003 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.136.254:46199
I20250109 21:09:03.640614 20003 env_posix.cc:2256] Not raising this process' open files per process limit of 1048576; it is already as high as it can go
I20250109 21:09:03.641551 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:09:03.657081 20009 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:03.657792 20010 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:03.658361 20012 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:03.658524 20003 server_base.cc:1034] running on GCE node
I20250109 21:09:04.817548 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:09:04.817785 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:09:04.817972 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736456944817948 us; error 0 us; skew 500 ppm
I20250109 21:09:04.818825 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:09:04.830104 20003 webserver.cc:458] Webserver started at http://127.19.136.254:33697/ using document root <none> and password file <none>
I20250109 21:09:04.831012 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:09:04.831214 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:09:04.831604 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:09:04.837528 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/master-0-root/instance:
uuid: "154408f3019e443ea208fc980d58c2af"
format_stamp: "Formatted at 2025-01-09 21:09:04 on dist-test-slave-sc47"
I20250109 21:09:04.845571 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.007s user 0.005s sys 0.004s
I20250109 21:09:04.850554 20018 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:04.851604 20003 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.002s
I20250109 21:09:04.851955 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/master-0-root
uuid: "154408f3019e443ea208fc980d58c2af"
format_stamp: "Formatted at 2025-01-09 21:09:04 on dist-test-slave-sc47"
I20250109 21:09:04.852277 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:09:04.905841 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:09:04.907328 20003 env_posix.cc:2256] Not raising this process' running threads per effective uid limit of 18446744073709551615; it is already as high as it can go
I20250109 21:09:04.907763 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:09:04.974694 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.254:46199
I20250109 21:09:04.974772 20070 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.254:46199 every 8 connection(s)
I20250109 21:09:04.981338 20071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.003247 20071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af: Bootstrap starting.
I20250109 21:09:05.008603 20071 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:05.010218 20071 log.cc:826] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af: Log is configured to *not* fsync() on all Append() calls
I20250109 21:09:05.014392 20071 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af: No bootstrap required, opened a new log
I20250109 21:09:05.034850 20071 raft_consensus.cc:357] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "154408f3019e443ea208fc980d58c2af" member_type: VOTER }
I20250109 21:09:05.035347 20071 raft_consensus.cc:383] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:05.035588 20071 raft_consensus.cc:738] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 154408f3019e443ea208fc980d58c2af, State: Initialized, Role: FOLLOWER
I20250109 21:09:05.036319 20071 consensus_queue.cc:260] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "154408f3019e443ea208fc980d58c2af" member_type: VOTER }
I20250109 21:09:05.036785 20071 raft_consensus.cc:397] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250109 21:09:05.037048 20071 raft_consensus.cc:491] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250109 21:09:05.037333 20071 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:05.040988 20071 raft_consensus.cc:513] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "154408f3019e443ea208fc980d58c2af" member_type: VOTER }
I20250109 21:09:05.041601 20071 leader_election.cc:304] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 154408f3019e443ea208fc980d58c2af; no voters:
I20250109 21:09:05.043262 20071 leader_election.cc:290] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [CANDIDATE]: Term 1 election: Requested vote from peers
I20250109 21:09:05.043620 20074 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:05.046150 20074 raft_consensus.cc:695] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 1 LEADER]: Becoming Leader. State: Replica: 154408f3019e443ea208fc980d58c2af, State: Running, Role: LEADER
I20250109 21:09:05.046979 20074 consensus_queue.cc:237] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "154408f3019e443ea208fc980d58c2af" member_type: VOTER }
I20250109 21:09:05.047963 20071 sys_catalog.cc:564] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [sys.catalog]: configured and running, proceeding with master startup.
I20250109 21:09:05.058027 20076 sys_catalog.cc:455] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [sys.catalog]: SysCatalogTable state changed. Reason: New leader 154408f3019e443ea208fc980d58c2af. Latest consensus state: current_term: 1 leader_uuid: "154408f3019e443ea208fc980d58c2af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "154408f3019e443ea208fc980d58c2af" member_type: VOTER } }
I20250109 21:09:05.058161 20075 sys_catalog.cc:455] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "154408f3019e443ea208fc980d58c2af" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "154408f3019e443ea208fc980d58c2af" member_type: VOTER } }
I20250109 21:09:05.058879 20075 sys_catalog.cc:458] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [sys.catalog]: This master's current role is: LEADER
I20250109 21:09:05.058902 20076 sys_catalog.cc:458] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [sys.catalog]: This master's current role is: LEADER
I20250109 21:09:05.067134 20084 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250109 21:09:05.075405 20084 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250109 21:09:05.077219 20003 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250109 21:09:05.089850 20084 catalog_manager.cc:1348] Generated new cluster ID: f1c6ad76cba24a05ad9b8083981f3674
I20250109 21:09:05.090142 20084 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250109 21:09:05.126125 20084 catalog_manager.cc:1371] Generated new certificate authority record
I20250109 21:09:05.127524 20084 catalog_manager.cc:1505] Loading token signing keys...
I20250109 21:09:05.146106 20084 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af: Generated new TSK 0
I20250109 21:09:05.146893 20084 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250109 21:09:05.207744 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:09:05.215644 20093 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:05.216869 20094 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:05.221727 20003 server_base.cc:1034] running on GCE node
W20250109 21:09:05.222744 20096 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:05.223603 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:09:05.223827 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:09:05.223989 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736456945223966 us; error 0 us; skew 500 ppm
I20250109 21:09:05.224540 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:09:05.228580 20003 webserver.cc:458] Webserver started at http://127.19.136.193:40811/ using document root <none> and password file <none>
I20250109 21:09:05.229045 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:09:05.229218 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:09:05.229456 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:09:05.230556 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-0-root/instance:
uuid: "a1a553af342645968202750fe6789cc4"
format_stamp: "Formatted at 2025-01-09 21:09:05 on dist-test-slave-sc47"
I20250109 21:09:05.235778 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.005s user 0.004s sys 0.000s
I20250109 21:09:05.239883 20101 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.240614 20003 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.001s sys 0.003s
I20250109 21:09:05.240864 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-0-root
uuid: "a1a553af342645968202750fe6789cc4"
format_stamp: "Formatted at 2025-01-09 21:09:05 on dist-test-slave-sc47"
I20250109 21:09:05.241117 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:09:05.274516 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:09:05.275774 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:09:05.278386 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:09:05.282650 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:09:05.282858 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.283142 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:09:05.283299 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.384903 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.193:46561
I20250109 21:09:05.384990 20163 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.193:46561 every 8 connection(s)
I20250109 21:09:05.392186 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:09:05.403226 20168 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:05.407303 20169 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:05.417165 20003 server_base.cc:1034] running on GCE node
W20250109 21:09:05.418594 20171 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:05.419786 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:09:05.420075 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:09:05.420279 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736456945420260 us; error 0 us; skew 500 ppm
I20250109 21:09:05.421062 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:09:05.421476 20164 heartbeater.cc:346] Connected to a master server at 127.19.136.254:46199
I20250109 21:09:05.422144 20164 heartbeater.cc:463] Registering TS with master...
I20250109 21:09:05.423166 20164 heartbeater.cc:510] Master 127.19.136.254:46199 requested a full tablet report, sending...
I20250109 21:09:05.424129 20003 webserver.cc:458] Webserver started at http://127.19.136.194:36807/ using document root <none> and password file <none>
I20250109 21:09:05.424808 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:09:05.425060 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:09:05.425383 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:09:05.425954 20035 ts_manager.cc:194] Registered new tserver with Master: a1a553af342645968202750fe6789cc4 (127.19.136.193:46561)
I20250109 21:09:05.426832 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-1-root/instance:
uuid: "07a3fea1966441738fb339af7620b856"
format_stamp: "Formatted at 2025-01-09 21:09:05 on dist-test-slave-sc47"
I20250109 21:09:05.428014 20035 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57190
I20250109 21:09:05.433429 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.006s user 0.006s sys 0.000s
I20250109 21:09:05.438169 20177 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.438999 20003 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20250109 21:09:05.439304 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-1-root
uuid: "07a3fea1966441738fb339af7620b856"
format_stamp: "Formatted at 2025-01-09 21:09:05 on dist-test-slave-sc47"
I20250109 21:09:05.439646 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:09:05.473256 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:09:05.474846 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:09:05.477246 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:09:05.480751 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:09:05.481004 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.481276 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:09:05.481479 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.564021 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.194:43165
I20250109 21:09:05.564100 20239 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.194:43165 every 8 connection(s)
I20250109 21:09:05.570936 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:09:05.582006 20244 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:05.583376 20243 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:05.588169 20240 heartbeater.cc:346] Connected to a master server at 127.19.136.254:46199
I20250109 21:09:05.588716 20240 heartbeater.cc:463] Registering TS with master...
I20250109 21:09:05.589947 20240 heartbeater.cc:510] Master 127.19.136.254:46199 requested a full tablet report, sending...
I20250109 21:09:05.591305 20003 server_base.cc:1034] running on GCE node
I20250109 21:09:05.592824 20035 ts_manager.cc:194] Registered new tserver with Master: 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
W20250109 21:09:05.593181 20246 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:05.594072 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:09:05.594273 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:09:05.594444 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736456945594425 us; error 0 us; skew 500 ppm
I20250109 21:09:05.594609 20035 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57204
I20250109 21:09:05.595022 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:09:05.597882 20003 webserver.cc:458] Webserver started at http://127.19.136.195:38467/ using document root <none> and password file <none>
I20250109 21:09:05.598330 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:09:05.598524 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:09:05.598775 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:09:05.599797 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-2-root/instance:
uuid: "5495cca8eac74118baf4bfc5f667bbc2"
format_stamp: "Formatted at 2025-01-09 21:09:05 on dist-test-slave-sc47"
I20250109 21:09:05.604238 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20250109 21:09:05.607434 20251 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.608213 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250109 21:09:05.608470 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-2-root
uuid: "5495cca8eac74118baf4bfc5f667bbc2"
format_stamp: "Formatted at 2025-01-09 21:09:05 on dist-test-slave-sc47"
I20250109 21:09:05.608752 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForDivided.1736456943481041-20003-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:09:05.619129 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:09:05.620211 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:09:05.622131 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:09:05.624934 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:09:05.625138 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.625346 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:09:05.625492 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:05.712371 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.195:45157
I20250109 21:09:05.712929 20314 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.195:45157 every 8 connection(s)
I20250109 21:09:05.728559 20315 heartbeater.cc:346] Connected to a master server at 127.19.136.254:46199
I20250109 21:09:05.728969 20315 heartbeater.cc:463] Registering TS with master...
I20250109 21:09:05.729638 20315 heartbeater.cc:510] Master 127.19.136.254:46199 requested a full tablet report, sending...
I20250109 21:09:05.731420 20035 ts_manager.cc:194] Registered new tserver with Master: 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:05.732386 20003 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013352717s
I20250109 21:09:05.732740 20035 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:57220
I20250109 21:09:05.736091 20003 test_util.cc:274] Using random seed: 1667963264
I20250109 21:09:05.783938 20035 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:57228:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250109 21:09:05.787410 20035 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250109 21:09:05.917999 20279 tablet_service.cc:1467] Processing CreateTablet for tablet 35d7f8e48199430e9f6d10be73921ec4 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:09:05.916052 20278 tablet_service.cc:1467] Processing CreateTablet for tablet bcbe2796a0194d17971ad21c4f3b8349 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:09:05.920948 20277 tablet_service.cc:1467] Processing CreateTablet for tablet 174eb905bb344a36b609bdfc743e54b9 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:09:05.923871 20276 tablet_service.cc:1467] Processing CreateTablet for tablet 88ba6d3a84814edabc5e283511f8b5f0 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:09:05.925060 20275 tablet_service.cc:1467] Processing CreateTablet for tablet b454cb03259b438c80f2cb7ac2e99aa5 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:09:05.927320 20279 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d7f8e48199430e9f6d10be73921ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.927335 20274 tablet_service.cc:1467] Processing CreateTablet for tablet e6e31d619e85499ebe76d5fd3807ee0a (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:09:05.928181 20276 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ba6d3a84814edabc5e283511f8b5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.931053 20277 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174eb905bb344a36b609bdfc743e54b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.931017 20273 tablet_service.cc:1467] Processing CreateTablet for tablet c47153f0561d4b60bbbbea6e0fcdefd9 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:09:05.933699 20272 tablet_service.cc:1467] Processing CreateTablet for tablet 8fff237d72c148e2b13859ace234ce22 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:09:05.938165 20271 tablet_service.cc:1467] Processing CreateTablet for tablet 6860c8ea384449b88d6e61be4217d27f (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:09:05.937342 20278 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbe2796a0194d17971ad21c4f3b8349. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.944307 20275 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b454cb03259b438c80f2cb7ac2e99aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.946885 20271 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6860c8ea384449b88d6e61be4217d27f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.951229 20205 tablet_service.cc:1467] Processing CreateTablet for tablet 35d7f8e48199430e9f6d10be73921ec4 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:09:05.952494 20205 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d7f8e48199430e9f6d10be73921ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.948807 20204 tablet_service.cc:1467] Processing CreateTablet for tablet bcbe2796a0194d17971ad21c4f3b8349 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:09:05.953570 20203 tablet_service.cc:1467] Processing CreateTablet for tablet 174eb905bb344a36b609bdfc743e54b9 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:09:05.956336 20204 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbe2796a0194d17971ad21c4f3b8349. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.958925 20274 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e31d619e85499ebe76d5fd3807ee0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.958056 20202 tablet_service.cc:1467] Processing CreateTablet for tablet 88ba6d3a84814edabc5e283511f8b5f0 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:09:05.964136 20203 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174eb905bb344a36b609bdfc743e54b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.965068 20273 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47153f0561d4b60bbbbea6e0fcdefd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.967810 20199 tablet_service.cc:1467] Processing CreateTablet for tablet c47153f0561d4b60bbbbea6e0fcdefd9 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:09:05.973659 20202 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ba6d3a84814edabc5e283511f8b5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.977243 20198 tablet_service.cc:1467] Processing CreateTablet for tablet 8fff237d72c148e2b13859ace234ce22 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:09:05.980957 20129 tablet_service.cc:1467] Processing CreateTablet for tablet 35d7f8e48199430e9f6d10be73921ec4 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:09:05.965029 20201 tablet_service.cc:1467] Processing CreateTablet for tablet b454cb03259b438c80f2cb7ac2e99aa5 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:09:05.967921 20200 tablet_service.cc:1467] Processing CreateTablet for tablet e6e31d619e85499ebe76d5fd3807ee0a (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:09:05.986310 20199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47153f0561d4b60bbbbea6e0fcdefd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.987048 20272 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fff237d72c148e2b13859ace234ce22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.991981 20129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35d7f8e48199430e9f6d10be73921ec4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.992723 20200 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e31d619e85499ebe76d5fd3807ee0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.991714 20127 tablet_service.cc:1467] Processing CreateTablet for tablet 174eb905bb344a36b609bdfc743e54b9 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:09:06.005461 20201 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b454cb03259b438c80f2cb7ac2e99aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.997720 20197 tablet_service.cc:1467] Processing CreateTablet for tablet 6860c8ea384449b88d6e61be4217d27f (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:09:05.997712 20126 tablet_service.cc:1467] Processing CreateTablet for tablet 88ba6d3a84814edabc5e283511f8b5f0 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:09:06.007279 20127 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 174eb905bb344a36b609bdfc743e54b9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:05.996742 20128 tablet_service.cc:1467] Processing CreateTablet for tablet bcbe2796a0194d17971ad21c4f3b8349 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:09:06.001677 20124 tablet_service.cc:1467] Processing CreateTablet for tablet e6e31d619e85499ebe76d5fd3807ee0a (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:09:06.001560 20125 tablet_service.cc:1467] Processing CreateTablet for tablet b454cb03259b438c80f2cb7ac2e99aa5 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:09:06.015038 20122 tablet_service.cc:1467] Processing CreateTablet for tablet 8fff237d72c148e2b13859ace234ce22 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:09:06.015462 20198 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fff237d72c148e2b13859ace234ce22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:06.019634 20121 tablet_service.cc:1467] Processing CreateTablet for tablet 6860c8ea384449b88d6e61be4217d27f (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:09:06.020743 20123 tablet_service.cc:1467] Processing CreateTablet for tablet c47153f0561d4b60bbbbea6e0fcdefd9 (DEFAULT_TABLE table=test-workload [id=ad7b2a4b821d477aa57e57e77730eb32]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:09:06.044310 20126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 88ba6d3a84814edabc5e283511f8b5f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:06.045740 20128 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bcbe2796a0194d17971ad21c4f3b8349. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:06.056043 20197 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6860c8ea384449b88d6e61be4217d27f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:06.062120 20121 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6860c8ea384449b88d6e61be4217d27f. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:09:06.068265 20083 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:09:06.069006 20122 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fff237d72c148e2b13859ace234ce22. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:06.071743 20123 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c47153f0561d4b60bbbbea6e0fcdefd9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:06.079370 20125 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b454cb03259b438c80f2cb7ac2e99aa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:06.080978 20124 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6e31d619e85499ebe76d5fd3807ee0a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:06.234987 20333 tablet_bootstrap.cc:492] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:06.249331 20334 tablet_bootstrap.cc:492] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4: Bootstrap starting.
I20250109 21:09:06.265269 20335 tablet_bootstrap.cc:492] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:06.286592 20333 tablet_bootstrap.cc:654] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.290892 20334 tablet_bootstrap.cc:654] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.292937 20335 tablet_bootstrap.cc:654] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.301159 20333 tablet_bootstrap.cc:492] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:06.301637 20333 ts_tablet_manager.cc:1397] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.086s user 0.012s sys 0.005s
I20250109 21:09:06.302618 20334 tablet_bootstrap.cc:492] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
I20250109 21:09:06.303148 20334 ts_tablet_manager.cc:1397] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.065s user 0.013s sys 0.006s
I20250109 21:09:06.303953 20335 tablet_bootstrap.cc:492] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:06.304361 20335 ts_tablet_manager.cc:1397] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.047s user 0.012s sys 0.004s
I20250109 21:09:06.305153 20333 raft_consensus.cc:357] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.305995 20333 raft_consensus.cc:383] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.306324 20333 raft_consensus.cc:738] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.306149 20334 raft_consensus.cc:357] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.307161 20334 raft_consensus.cc:383] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.306955 20335 raft_consensus.cc:357] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.307072 20333 consensus_queue.cc:260] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.307560 20334 raft_consensus.cc:738] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.307734 20335 raft_consensus.cc:383] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.308184 20335 raft_consensus.cc:738] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.308863 20335 consensus_queue.cc:260] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.308557 20334 consensus_queue.cc:260] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.316816 20333 ts_tablet_manager.cc:1428] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.015s user 0.007s sys 0.008s
I20250109 21:09:06.317818 20315 heartbeater.cc:502] Master 127.19.136.254:46199 was elected leader, sending a full tablet report...
I20250109 21:09:06.318245 20333 tablet_bootstrap.cc:492] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:06.319082 20335 ts_tablet_manager.cc:1428] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.014s user 0.008s sys 0.007s
I20250109 21:09:06.319703 20334 ts_tablet_manager.cc:1428] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.016s user 0.007s sys 0.007s
I20250109 21:09:06.319712 20240 heartbeater.cc:502] Master 127.19.136.254:46199 was elected leader, sending a full tablet report...
I20250109 21:09:06.320791 20334 tablet_bootstrap.cc:492] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4: Bootstrap starting.
I20250109 21:09:06.322124 20164 heartbeater.cc:502] Master 127.19.136.254:46199 was elected leader, sending a full tablet report...
W20250109 21:09:06.325450 20241 tablet.cc:2367] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250109 21:09:06.328510 20335 tablet_bootstrap.cc:492] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:06.332803 20334 tablet_bootstrap.cc:654] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.336464 20333 tablet_bootstrap.cc:654] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.338665 20335 tablet_bootstrap.cc:654] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.370415 20334 tablet_bootstrap.cc:492] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
I20250109 21:09:06.371065 20334 ts_tablet_manager.cc:1397] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.050s user 0.014s sys 0.003s
I20250109 21:09:06.374637 20334 raft_consensus.cc:357] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.386572 20334 raft_consensus.cc:383] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.386870 20334 raft_consensus.cc:738] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.388059 20335 tablet_bootstrap.cc:492] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:06.388674 20335 ts_tablet_manager.cc:1397] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.060s user 0.030s sys 0.018s
I20250109 21:09:06.388031 20334 consensus_queue.cc:260] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.392205 20334 ts_tablet_manager.cc:1428] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.021s user 0.008s sys 0.000s
I20250109 21:09:06.394143 20333 tablet_bootstrap.cc:492] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:06.394798 20333 ts_tablet_manager.cc:1397] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.077s user 0.021s sys 0.034s
I20250109 21:09:06.395709 20334 tablet_bootstrap.cc:492] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4: Bootstrap starting.
I20250109 21:09:06.398654 20333 raft_consensus.cc:357] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.399571 20333 raft_consensus.cc:383] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.399932 20333 raft_consensus.cc:738] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.400681 20335 raft_consensus.cc:357] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.401459 20335 raft_consensus.cc:383] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.401746 20335 raft_consensus.cc:738] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.400653 20333 consensus_queue.cc:260] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.404055 20335 consensus_queue.cc:260] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.406272 20335 ts_tablet_manager.cc:1428] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20250109 21:09:06.407159 20335 tablet_bootstrap.cc:492] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:06.409641 20334 tablet_bootstrap.cc:654] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.417832 20335 tablet_bootstrap.cc:654] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.418946 20333 ts_tablet_manager.cc:1428] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20250109 21:09:06.419963 20333 tablet_bootstrap.cc:492] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:06.428941 20335 tablet_bootstrap.cc:492] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:06.429262 20334 tablet_bootstrap.cc:492] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
I20250109 21:09:06.429400 20335 ts_tablet_manager.cc:1397] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.022s user 0.009s sys 0.005s
I20250109 21:09:06.429759 20334 ts_tablet_manager.cc:1397] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.034s user 0.013s sys 0.003s
I20250109 21:09:06.431519 20333 tablet_bootstrap.cc:654] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.432066 20335 raft_consensus.cc:357] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.432803 20335 raft_consensus.cc:383] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.432641 20334 raft_consensus.cc:357] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.433133 20335 raft_consensus.cc:738] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.433430 20334 raft_consensus.cc:383] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.433907 20334 raft_consensus.cc:738] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.434034 20335 consensus_queue.cc:260] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.434767 20334 consensus_queue.cc:260] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.436722 20335 ts_tablet_manager.cc:1428] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20250109 21:09:06.438706 20334 ts_tablet_manager.cc:1428] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.009s user 0.007s sys 0.001s
I20250109 21:09:06.440034 20334 tablet_bootstrap.cc:492] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4: Bootstrap starting.
I20250109 21:09:06.440646 20335 tablet_bootstrap.cc:492] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:06.450732 20335 tablet_bootstrap.cc:654] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.453058 20333 tablet_bootstrap.cc:492] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:06.453437 20333 ts_tablet_manager.cc:1397] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.034s user 0.012s sys 0.003s
I20250109 21:09:06.452603 20334 tablet_bootstrap.cc:654] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.455683 20333 raft_consensus.cc:357] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.456547 20333 raft_consensus.cc:383] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.456892 20333 raft_consensus.cc:738] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.457649 20333 consensus_queue.cc:260] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.469184 20333 ts_tablet_manager.cc:1428] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20250109 21:09:06.478384 20333 tablet_bootstrap.cc:492] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:06.486727 20333 tablet_bootstrap.cc:654] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.490960 20334 tablet_bootstrap.cc:492] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
I20250109 21:09:06.491617 20334 ts_tablet_manager.cc:1397] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.052s user 0.012s sys 0.029s
I20250109 21:09:06.491696 20335 tablet_bootstrap.cc:492] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:06.492318 20335 ts_tablet_manager.cc:1397] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.052s user 0.023s sys 0.019s
I20250109 21:09:06.494822 20335 raft_consensus.cc:357] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.495575 20335 raft_consensus.cc:383] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.495993 20335 raft_consensus.cc:738] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.495350 20334 raft_consensus.cc:357] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.496855 20334 raft_consensus.cc:383] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.496665 20335 consensus_queue.cc:260] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.497285 20334 raft_consensus.cc:738] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.498482 20341 raft_consensus.cc:491] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.498131 20334 consensus_queue.cc:260] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.498957 20341 raft_consensus.cc:513] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.499444 20335 ts_tablet_manager.cc:1428] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250109 21:09:06.500355 20335 tablet_bootstrap.cc:492] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:06.501847 20341 leader_election.cc:290] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.518702 20334 ts_tablet_manager.cc:1428] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.027s user 0.006s sys 0.006s
I20250109 21:09:06.519941 20334 tablet_bootstrap.cc:492] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4: Bootstrap starting.
I20250109 21:09:06.528692 20334 tablet_bootstrap.cc:654] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.529218 20333 tablet_bootstrap.cc:492] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:06.529762 20333 ts_tablet_manager.cc:1397] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.052s user 0.018s sys 0.005s
I20250109 21:09:06.530097 20335 tablet_bootstrap.cc:654] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.533139 20333 raft_consensus.cc:357] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.537329 20333 raft_consensus.cc:383] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.537626 20333 raft_consensus.cc:738] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.538308 20333 consensus_queue.cc:260] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.540812 20334 tablet_bootstrap.cc:492] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
I20250109 21:09:06.543715 20334 ts_tablet_manager.cc:1397] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.009s
I20250109 21:09:06.543759 20333 ts_tablet_manager.cc:1428] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20250109 21:09:06.544812 20333 tablet_bootstrap.cc:492] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:06.551615 20333 tablet_bootstrap.cc:654] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.551187 20334 raft_consensus.cc:357] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.554805 20334 raft_consensus.cc:383] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.555202 20334 raft_consensus.cc:738] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.555992 20334 consensus_queue.cc:260] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.559969 20334 ts_tablet_manager.cc:1428] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20250109 21:09:06.560910 20334 tablet_bootstrap.cc:492] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4: Bootstrap starting.
I20250109 21:09:06.573496 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:06.575290 20289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:06.576156 20289 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 0.
W20250109 21:09:06.576534 20102 leader_election.cc:343] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.577858 20340 raft_consensus.cc:491] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.578279 20103 leader_election.cc:304] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters: 07a3fea1966441738fb339af7620b856
I20250109 21:09:06.578544 20340 raft_consensus.cc:513] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.581672 20335 tablet_bootstrap.cc:492] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:06.582234 20333 tablet_bootstrap.cc:492] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:06.582304 20351 raft_consensus.cc:2798] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:06.582700 20334 tablet_bootstrap.cc:654] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.582836 20351 raft_consensus.cc:491] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:06.583007 20333 ts_tablet_manager.cc:1397] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.038s user 0.013s sys 0.006s
I20250109 21:09:06.582228 20335 ts_tablet_manager.cc:1397] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.082s user 0.012s sys 0.018s
I20250109 21:09:06.583341 20340 leader_election.cc:290] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157), a1a553af342645968202750fe6789cc4 (127.19.136.193:46561)
I20250109 21:09:06.583526 20351 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.583235 20339 raft_consensus.cc:491] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.588830 20341 raft_consensus.cc:491] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.586127 20339 raft_consensus.cc:513] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.590116 20341 raft_consensus.cc:513] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.602391 20341 leader_election.cc:290] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.603528 20289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c47153f0561d4b60bbbbea6e0fcdefd9" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:06.607795 20351 raft_consensus.cc:513] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.611464 20339 leader_election.cc:290] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:06.623993 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c47153f0561d4b60bbbbea6e0fcdefd9" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:06.625660 20339 raft_consensus.cc:491] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.626148 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:06.626317 20339 raft_consensus.cc:513] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
W20250109 21:09:06.632174 20102 leader_election.cc:343] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:09:06.639036 20102 leader_election.cc:343] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.639895 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:06.640602 20288 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.638244 20335 raft_consensus.cc:357] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.641578 20335 raft_consensus.cc:383] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.641870 20335 raft_consensus.cc:738] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.642768 20341 raft_consensus.cc:491] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:09:06.642967 20103 leader_election.cc:343] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.643401 20103 leader_election.cc:304] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: a1a553af342645968202750fe6789cc4; no voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:06.643362 20341 raft_consensus.cc:513] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.645511 20341 leader_election.cc:290] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:06.646019 20341 raft_consensus.cc:2743] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:06.647542 20288 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 1.
I20250109 21:09:06.648265 20351 leader_election.cc:290] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.642589 20335 consensus_queue.cc:260] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.650272 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:06.651095 20215 raft_consensus.cc:2463] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 0.
I20250109 21:09:06.648983 20103 leader_election.cc:304] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters: 07a3fea1966441738fb339af7620b856
I20250109 21:09:06.650079 20339 leader_election.cc:290] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:06.652599 20102 leader_election.cc:304] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:06.652401 20333 raft_consensus.cc:357] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.653326 20333 raft_consensus.cc:383] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.653672 20333 raft_consensus.cc:738] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.653873 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:06.655231 20366 raft_consensus.cc:2798] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:06.655658 20366 raft_consensus.cc:491] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:06.656035 20334 tablet_bootstrap.cc:492] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
I20250109 21:09:06.655983 20366 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.654122 20351 raft_consensus.cc:2798] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:06.654857 20335 ts_tablet_manager.cc:1428] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.070s user 0.007s sys 0.001s
I20250109 21:09:06.658843 20335 tablet_bootstrap.cc:492] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:06.659093 20351 raft_consensus.cc:695] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:06.659921 20351 consensus_queue.cc:237] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.661383 20334 ts_tablet_manager.cc:1397] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.101s user 0.024s sys 0.009s
I20250109 21:09:06.656756 20333 consensus_queue.cc:260] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.669376 20334 raft_consensus.cc:357] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.670038 20335 tablet_bootstrap.cc:654] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.674052 20333 ts_tablet_manager.cc:1428] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.089s user 0.005s sys 0.011s
I20250109 21:09:06.670282 20334 raft_consensus.cc:383] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.675487 20139 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:06.676206 20333 tablet_bootstrap.cc:492] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:06.672055 20288 raft_consensus.cc:2463] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 0.
I20250109 21:09:06.676393 20334 raft_consensus.cc:738] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.679966 20334 consensus_queue.cc:260] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.688151 20339 raft_consensus.cc:491] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.689103 20339 raft_consensus.cc:513] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.693482 20339 leader_election.cc:290] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:06.698310 20334 ts_tablet_manager.cc:1428] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.032s user 0.004s sys 0.003s
I20250109 21:09:06.696658 20366 raft_consensus.cc:513] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.702474 20139 raft_consensus.cc:2388] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07a3fea1966441738fb339af7620b856 in current term 1: Already voted for candidate a1a553af342645968202750fe6789cc4 in this term.
I20250109 21:09:06.708364 20137 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
W20250109 21:09:06.712877 20255 leader_election.cc:343] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a553af342645968202750fe6789cc4 (127.19.136.193:46561): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.713238 20366 leader_election.cc:290] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Requested vote from peers 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:06.707926 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:06.713889 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:06.714648 20288 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.714520 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:06.715399 20215 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.708518 20334 tablet_bootstrap.cc:492] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4: Bootstrap starting.
W20250109 21:09:06.717599 20255 leader_election.cc:343] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer a1a553af342645968202750fe6789cc4 (127.19.136.193:46561): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.713887 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:06.719311 20138 raft_consensus.cc:2463] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 0.
I20250109 21:09:06.720670 20255 leader_election.cc:304] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:06.722384 20339 raft_consensus.cc:2798] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:06.722893 20339 raft_consensus.cc:491] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:06.723318 20339 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.729171 20215 raft_consensus.cc:2463] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 1.
I20250109 21:09:06.730276 20102 leader_election.cc:304] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:06.731534 20288 raft_consensus.cc:2463] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 1.
I20250109 21:09:06.732605 20366 raft_consensus.cc:2798] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:06.734988 20333 tablet_bootstrap.cc:654] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.735855 20366 raft_consensus.cc:695] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:06.737527 20366 consensus_queue.cc:237] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:06.737730 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:06.739569 20339 raft_consensus.cc:513] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.741428 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:06.741585 20288 raft_consensus.cc:2388] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07a3fea1966441738fb339af7620b856 in current term 1: Already voted for candidate a1a553af342645968202750fe6789cc4 in this term.
I20250109 21:09:06.744467 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:06.742053 20214 raft_consensus.cc:2463] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 0.
I20250109 21:09:06.740852 20213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:06.744627 20179 leader_election.cc:304] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07a3fea1966441738fb339af7620b856; no voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4
I20250109 21:09:06.746208 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:06.744347 20339 leader_election.cc:290] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:06.747538 20138 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.745939 20215 raft_consensus.cc:2463] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 0.
I20250109 21:09:06.748659 20340 raft_consensus.cc:2743] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:06.752863 20252 leader_election.cc:304] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2; no voters: a1a553af342645968202750fe6789cc4
W20250109 21:09:06.755276 20252 leader_election.cc:343] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.775112 20138 raft_consensus.cc:2463] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 1.
I20250109 21:09:06.754738 20339 raft_consensus.cc:2798] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:06.775296 20252 leader_election.cc:304] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2; no voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4
I20250109 21:09:06.776294 20255 leader_election.cc:304] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:06.762071 20340 raft_consensus.cc:491] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.776760 20339 raft_consensus.cc:491] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:06.768141 20035 catalog_manager.cc:5526] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:06.754595 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:06.779551 20335 tablet_bootstrap.cc:492] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:06.778026 20340 raft_consensus.cc:513] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.779016 20339 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.786370 20335 ts_tablet_manager.cc:1397] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.128s user 0.012s sys 0.005s
I20250109 21:09:06.783915 20334 tablet_bootstrap.cc:654] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.786792 20215 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.790409 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:06.790645 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:06.791085 20138 raft_consensus.cc:2463] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 0.
I20250109 21:09:06.790818 20335 raft_consensus.cc:357] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.791671 20335 raft_consensus.cc:383] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250109 21:09:06.792028 20179 leader_election.cc:343] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.792124 20335 raft_consensus.cc:738] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.792698 20340 leader_election.cc:290] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.793085 20181 leader_election.cc:304] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters: 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:06.793251 20335 consensus_queue.cc:260] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.794957 20340 raft_consensus.cc:2798] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:06.797216 20340 raft_consensus.cc:491] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:06.797703 20340 raft_consensus.cc:3054] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.802412 20371 raft_consensus.cc:2743] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:06.804708 20333 tablet_bootstrap.cc:492] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:06.805212 20333 ts_tablet_manager.cc:1397] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.130s user 0.010s sys 0.010s
I20250109 21:09:06.803920 20371 raft_consensus.cc:2798] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:06.822172 20339 raft_consensus.cc:513] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.817822 20371 raft_consensus.cc:695] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Becoming Leader. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:06.825258 20372 raft_consensus.cc:491] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.825903 20215 raft_consensus.cc:2463] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 1.
I20250109 21:09:06.825747 20372 raft_consensus.cc:513] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.827104 20366 raft_consensus.cc:491] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.829782 20366 raft_consensus.cc:513] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.825985 20371 consensus_queue.cc:237] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.830389 20340 raft_consensus.cc:513] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.831743 20366 leader_election.cc:290] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.829149 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:06.825403 20335 ts_tablet_manager.cc:1428] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.038s user 0.006s sys 0.016s
W20250109 21:09:06.824002 20252 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:43165, user_credentials={real_user=slave}} blocked reactor thread for 68892.3us
I20250109 21:09:06.835289 20372 leader_election.cc:290] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.834383 20289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:06.832734 20340 leader_election.cc:290] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.833215 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860c8ea384449b88d6e61be4217d27f" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:06.836787 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:06.837325 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:06.837924 20289 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:06.840413 20289 raft_consensus.cc:2388] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 07a3fea1966441738fb339af7620b856 in current term 1: Already voted for candidate a1a553af342645968202750fe6789cc4 in this term.
W20250109 21:09:06.838829 20179 leader_election.cc:343] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.842831 20333 raft_consensus.cc:357] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.837338 20138 raft_consensus.cc:3054] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.844972 20339 leader_election.cc:290] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:06.843567 20333 raft_consensus.cc:383] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.846863 20333 raft_consensus.cc:738] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.847558 20333 consensus_queue.cc:260] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.848179 20213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:06.848491 20288 raft_consensus.cc:2463] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 0.
I20250109 21:09:06.848750 20213 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.848836 20181 leader_election.cc:304] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 07a3fea1966441738fb339af7620b856; no voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4
I20250109 21:09:06.843533 20335 tablet_bootstrap.cc:492] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:06.849720 20103 leader_election.cc:304] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:06.851230 20366 raft_consensus.cc:2798] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:06.851595 20366 raft_consensus.cc:491] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:06.851928 20366 raft_consensus.cc:3054] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.855046 20334 tablet_bootstrap.cc:492] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
W20250109 21:09:06.856797 20255 leader_election.cc:343] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer a1a553af342645968202750fe6789cc4 (127.19.136.193:46561): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.859966 20138 raft_consensus.cc:2463] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 1.
I20250109 21:09:06.855537 20334 ts_tablet_manager.cc:1397] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.147s user 0.016s sys 0.011s
I20250109 21:09:06.862857 20181 leader_election.cc:304] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters: 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:06.863940 20340 raft_consensus.cc:2798] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:06.864419 20340 raft_consensus.cc:695] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:06.865070 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860c8ea384449b88d6e61be4217d27f" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:06.865485 20340 consensus_queue.cc:237] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
W20250109 21:09:06.866274 20102 leader_election.cc:343] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.864081 20333 ts_tablet_manager.cc:1428] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.054s user 0.007s sys 0.000s
I20250109 21:09:06.868206 20213 raft_consensus.cc:2463] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 1.
I20250109 21:09:06.870254 20252 leader_election.cc:304] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2; no voters: a1a553af342645968202750fe6789cc4
I20250109 21:09:06.871253 20339 raft_consensus.cc:2798] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:06.870648 20366 raft_consensus.cc:513] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.871770 20339 raft_consensus.cc:695] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Becoming Leader. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:06.875092 20366 leader_election.cc:290] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.878002 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860c8ea384449b88d6e61be4217d27f" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:06.878396 20213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860c8ea384449b88d6e61be4217d27f" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:06.878600 20288 raft_consensus.cc:3054] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.879016 20339 consensus_queue.cc:237] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.873471 20333 tablet_bootstrap.cc:492] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:06.871580 20376 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.880863 20334 raft_consensus.cc:357] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
W20250109 21:09:06.881201 20102 leader_election.cc:343] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.881608 20334 raft_consensus.cc:383] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.881916 20334 raft_consensus.cc:738] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.882573 20334 consensus_queue.cc:260] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.886173 20334 ts_tablet_manager.cc:1428] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.024s user 0.006s sys 0.000s
I20250109 21:09:06.887163 20334 tablet_bootstrap.cc:492] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4: Bootstrap starting.
I20250109 21:09:06.899772 20288 raft_consensus.cc:2463] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 1.
I20250109 21:09:06.901016 20333 tablet_bootstrap.cc:654] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.900655 20335 tablet_bootstrap.cc:654] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.901702 20103 leader_election.cc:304] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters: 07a3fea1966441738fb339af7620b856
I20250109 21:09:06.904595 20366 raft_consensus.cc:2798] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:06.905081 20366 raft_consensus.cc:695] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:06.905862 20366 consensus_queue.cc:237] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.906562 20334 tablet_bootstrap.cc:654] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.900559 20033 catalog_manager.cc:5526] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:06.918488 20376 raft_consensus.cc:2743] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:06.940320 20334 tablet_bootstrap.cc:492] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
I20250109 21:09:06.940790 20334 ts_tablet_manager.cc:1397] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.054s user 0.018s sys 0.000s
I20250109 21:09:06.941816 20333 tablet_bootstrap.cc:492] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:06.942354 20333 ts_tablet_manager.cc:1397] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.070s user 0.009s sys 0.007s
I20250109 21:09:06.943138 20335 tablet_bootstrap.cc:492] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:06.943614 20335 ts_tablet_manager.cc:1397] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.100s user 0.013s sys 0.002s
I20250109 21:09:06.943924 20334 raft_consensus.cc:357] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.944605 20334 raft_consensus.cc:383] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.944860 20334 raft_consensus.cc:738] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.945423 20334 consensus_queue.cc:260] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.946735 20335 raft_consensus.cc:357] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.945652 20333 raft_consensus.cc:357] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.947444 20334 ts_tablet_manager.cc:1428] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20250109 21:09:06.947608 20335 raft_consensus.cc:383] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.947696 20333 raft_consensus.cc:383] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:06.947990 20335 raft_consensus.cc:738] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.948027 20333 raft_consensus.cc:738] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:06.948303 20334 tablet_bootstrap.cc:492] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4: Bootstrap starting.
I20250109 21:09:06.948798 20335 consensus_queue.cc:260] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.948998 20333 consensus_queue.cc:260] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.951792 20335 ts_tablet_manager.cc:1428] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.008s user 0.007s sys 0.001s
I20250109 21:09:06.953365 20335 tablet_bootstrap.cc:492] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:06.956084 20334 tablet_bootstrap.cc:654] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.957281 20333 ts_tablet_manager.cc:1428] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.014s user 0.006s sys 0.001s
I20250109 21:09:06.959717 20333 tablet_bootstrap.cc:492] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:06.962373 20335 tablet_bootstrap.cc:654] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.972239 20376 raft_consensus.cc:491] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.973353 20376 raft_consensus.cc:513] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.978135 20376 leader_election.cc:290] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:06.980293 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
W20250109 21:09:06.982599 20179 leader_election.cc:343] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:06.979127 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:06.982944 20333 tablet_bootstrap.cc:654] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:06.982987 20339 raft_consensus.cc:491] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:06.987869 20138 raft_consensus.cc:2463] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 0.
I20250109 21:09:06.988214 20339 raft_consensus.cc:513] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:06.988981 20181 leader_election.cc:304] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters: 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:06.990340 20376 raft_consensus.cc:2798] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:06.990684 20376 raft_consensus.cc:491] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:06.991032 20376 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.990865 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:06.992813 20136 raft_consensus.cc:2388] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5495cca8eac74118baf4bfc5f667bbc2 in current term 1: Already voted for candidate 07a3fea1966441738fb339af7620b856 in this term.
I20250109 21:09:06.994040 20213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:06.996070 20033 catalog_manager.cc:5526] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:06.999774 20255 leader_election.cc:304] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2; no voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4
I20250109 21:09:07.000262 20376 raft_consensus.cc:513] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.000633 20371 raft_consensus.cc:3054] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.002866 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:07.003430 20138 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:06.992017 20339 leader_election.cc:290] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:07.008726 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
W20250109 21:09:07.009938 20179 leader_election.cc:343] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:07.010421 20376 leader_election.cc:290] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:07.006841 20371 raft_consensus.cc:2743] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:07.017673 20335 tablet_bootstrap.cc:492] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:07.018332 20335 ts_tablet_manager.cc:1397] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.065s user 0.021s sys 0.020s
I20250109 21:09:07.021374 20035 catalog_manager.cc:5526] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:07.021660 20335 raft_consensus.cc:357] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.022554 20335 raft_consensus.cc:383] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:07.022881 20335 raft_consensus.cc:738] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:07.023730 20335 consensus_queue.cc:260] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.026618 20335 ts_tablet_manager.cc:1428] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20250109 21:09:07.027033 20138 raft_consensus.cc:2463] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 1.
I20250109 21:09:07.027616 20335 tablet_bootstrap.cc:492] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856: Bootstrap starting.
I20250109 21:09:07.028107 20181 leader_election.cc:304] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters: 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:07.029476 20376 raft_consensus.cc:2798] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:07.029927 20376 raft_consensus.cc:695] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:07.030663 20376 consensus_queue.cc:237] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.033922 20032 catalog_manager.cc:5526] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:07.035264 20335 tablet_bootstrap.cc:654] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:07.035684 20032 catalog_manager.cc:5526] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:07.044659 20333 tablet_bootstrap.cc:492] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:07.045094 20333 ts_tablet_manager.cc:1397] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.086s user 0.018s sys 0.014s
I20250109 21:09:07.047195 20333 raft_consensus.cc:357] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.047868 20333 raft_consensus.cc:383] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:07.048509 20333 raft_consensus.cc:738] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:07.049096 20333 consensus_queue.cc:260] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.050539 20333 ts_tablet_manager.cc:1428] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250109 21:09:07.051458 20333 tablet_bootstrap.cc:492] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2: Bootstrap starting.
I20250109 21:09:07.052047 20335 tablet_bootstrap.cc:492] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856: No bootstrap required, opened a new log
I20250109 21:09:07.052418 20335 ts_tablet_manager.cc:1397] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856: Time spent bootstrapping tablet: real 0.025s user 0.003s sys 0.013s
I20250109 21:09:07.054764 20335 raft_consensus.cc:357] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.055455 20335 raft_consensus.cc:383] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:07.055735 20335 raft_consensus.cc:738] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Initialized, Role: FOLLOWER
I20250109 21:09:07.056622 20333 tablet_bootstrap.cc:654] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:07.056260 20335 consensus_queue.cc:260] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.058326 20335 ts_tablet_manager.cc:1428] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856: Time spent starting tablet: real 0.006s user 0.002s sys 0.002s
I20250109 21:09:07.060820 20333 tablet_bootstrap.cc:492] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2: No bootstrap required, opened a new log
I20250109 21:09:07.061134 20333 ts_tablet_manager.cc:1397] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent bootstrapping tablet: real 0.010s user 0.001s sys 0.007s
I20250109 21:09:07.063622 20333 raft_consensus.cc:357] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.064092 20333 raft_consensus.cc:383] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:07.064256 20333 raft_consensus.cc:738] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Initialized, Role: FOLLOWER
I20250109 21:09:07.064702 20333 consensus_queue.cc:260] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.072002 20334 tablet_bootstrap.cc:492] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4: No bootstrap required, opened a new log
I20250109 21:09:07.072316 20334 ts_tablet_manager.cc:1397] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4: Time spent bootstrapping tablet: real 0.124s user 0.029s sys 0.009s
I20250109 21:09:07.071574 20035 catalog_manager.cc:5526] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:07.073854 20334 raft_consensus.cc:357] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.075798 20333 ts_tablet_manager.cc:1428] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20250109 21:09:07.074405 20334 raft_consensus.cc:383] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:07.076540 20334 raft_consensus.cc:738] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Initialized, Role: FOLLOWER
I20250109 21:09:07.077107 20334 consensus_queue.cc:260] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.079157 20334 ts_tablet_manager.cc:1428] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4: Time spent starting tablet: real 0.007s user 0.003s sys 0.002s
W20250109 21:09:07.084040 20083 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:09:07.159963 20366 consensus_queue.cc:1035] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.167621 20341 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.174502 20341 raft_consensus.cc:491] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:07.175132 20341 raft_consensus.cc:513] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.177457 20341 leader_election.cc:290] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:07.178059 20213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:07.178668 20213 raft_consensus.cc:2463] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 0.
I20250109 21:09:07.179296 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:07.179879 20102 leader_election.cc:304] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:07.180158 20287 raft_consensus.cc:2463] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 0.
I20250109 21:09:07.180616 20341 raft_consensus.cc:2798] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:07.180929 20341 raft_consensus.cc:491] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:07.181259 20341 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.188535 20341 raft_consensus.cc:513] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.193288 20341 leader_election.cc:290] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:07.194948 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:07.196689 20288 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.212947 20288 raft_consensus.cc:2463] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 1.
I20250109 21:09:07.213874 20103 leader_election.cc:304] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:07.214725 20341 raft_consensus.cc:2798] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:07.215430 20341 raft_consensus.cc:695] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:07.217301 20341 consensus_queue.cc:237] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.221163 20213 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:07.221711 20213 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.227020 20351 consensus_queue.cc:1035] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.227203 20033 catalog_manager.cc:5526] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 0 to 1, leader changed from <none> to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:07.226686 20341 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:09:07.233819 20213 raft_consensus.cc:2463] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 1.
I20250109 21:09:07.259779 20371 consensus_queue.cc:1035] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.271625 20371 consensus_queue.cc:1035] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.285187 20138 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.291872 20406 consensus_queue.cc:1035] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.306890 20373 consensus_queue.cc:1035] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:09:07.307322 20215 raft_consensus.cc:3054] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.308722 20376 raft_consensus.cc:491] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:07.309170 20376 raft_consensus.cc:513] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.312779 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c47153f0561d4b60bbbbea6e0fcdefd9" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:07.313403 20136 raft_consensus.cc:2463] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 0.
I20250109 21:09:07.317145 20341 consensus_queue.cc:1035] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.316779 20181 leader_election.cc:304] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:07.321687 20340 raft_consensus.cc:2798] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:07.322017 20340 raft_consensus.cc:491] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:07.322314 20340 raft_consensus.cc:3054] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.322600 20376 leader_election.cc:290] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:07.323971 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c47153f0561d4b60bbbbea6e0fcdefd9" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2" is_pre_election: true
I20250109 21:09:07.324864 20288 raft_consensus.cc:2463] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 0.
I20250109 21:09:07.329954 20340 raft_consensus.cc:513] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.332698 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c47153f0561d4b60bbbbea6e0fcdefd9" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:07.333241 20138 raft_consensus.cc:3054] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.344391 20138 raft_consensus.cc:2463] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 1.
I20250109 21:09:07.345358 20181 leader_election.cc:304] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:07.346133 20372 consensus_queue.cc:1035] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.347342 20376 raft_consensus.cc:2798] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:07.347810 20376 raft_consensus.cc:695] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:07.348588 20376 consensus_queue.cc:237] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.357609 20351 consensus_queue.cc:1035] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.366837 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c47153f0561d4b60bbbbea6e0fcdefd9" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:07.367519 20287 raft_consensus.cc:3054] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.370805 20406 raft_consensus.cc:491] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:07.371305 20406 raft_consensus.cc:513] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.373099 20406 leader_election.cc:290] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:07.374861 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "a1a553af342645968202750fe6789cc4" is_pre_election: true
I20250109 21:09:07.375629 20136 raft_consensus.cc:2388] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 5495cca8eac74118baf4bfc5f667bbc2 in current term 1: Already voted for candidate 07a3fea1966441738fb339af7620b856 in this term.
I20250109 21:09:07.374588 20287 raft_consensus.cc:2463] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 1.
I20250109 21:09:07.378199 20340 leader_election.cc:290] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 1 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:07.379650 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "07a3fea1966441738fb339af7620b856" is_pre_election: true
I20250109 21:09:07.383168 20033 catalog_manager.cc:5526] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 0 to 1, leader changed from <none> to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:07.386735 20372 consensus_queue.cc:1035] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.387827 20252 leader_election.cc:304] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2; no voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4
I20250109 21:09:07.388993 20406 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:07.396754 20406 raft_consensus.cc:2743] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:07.492630 20415 consensus_queue.cc:1035] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.501248 20372 consensus_queue.cc:1035] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.736904 20288 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
mode: GRACEFUL
new_leader_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:39600
I20250109 21:09:07.737643 20288 raft_consensus.cc:604] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Received request to transfer leadership to TS a1a553af342645968202750fe6789cc4
I20250109 21:09:07.753170 20214 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0"
dest_uuid: "07a3fea1966441738fb339af7620b856"
mode: GRACEFUL
new_leader_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:59966
I20250109 21:09:07.753648 20214 raft_consensus.cc:604] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Received request to transfer leadership to TS a1a553af342645968202750fe6789cc4
I20250109 21:09:07.759176 20341 consensus_queue.cc:1035] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.775722 20340 consensus_queue.cc:1035] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.779063 20399 consensus_queue.cc:1035] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:07.800338 20340 consensus_queue.cc:1035] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:09:07.817224 20138 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5"
dest_uuid: "a1a553af342645968202750fe6789cc4"
mode: GRACEFUL
new_leader_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:52992
I20250109 21:09:07.817853 20138 raft_consensus.cc:604] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Received request to transfer leadership to TS 07a3fea1966441738fb339af7620b856
I20250109 21:09:07.821801 20406 raft_consensus.cc:988] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2: : Instructing follower a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:07.822216 20406 raft_consensus.cc:1076] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Signalling peer a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:07.825196 20287 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
mode: GRACEFUL
new_leader_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:39600
I20250109 21:09:07.825580 20138 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349"
dest_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:37418
I20250109 21:09:07.825958 20287 raft_consensus.cc:604] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Received request to transfer leadership to TS 07a3fea1966441738fb339af7620b856
I20250109 21:09:07.826301 20138 raft_consensus.cc:491] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:07.826757 20138 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:07.834012 20138 raft_consensus.cc:513] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.836354 20138 leader_election.cc:290] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 2 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:07.836419 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:07.837078 20214 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:07.837533 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:07.838577 20287 raft_consensus.cc:3049] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:07.838974 20287 raft_consensus.cc:738] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:07.839833 20287 consensus_queue.cc:260] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.841378 20287 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:07.840204 20138 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "6860c8ea384449b88d6e61be4217d27f"
dest_uuid: "a1a553af342645968202750fe6789cc4"
mode: GRACEFUL
new_leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:52992
I20250109 21:09:07.843302 20138 raft_consensus.cc:604] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Received request to transfer leadership to TS 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:07.846388 20214 raft_consensus.cc:2463] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 2.
I20250109 21:09:07.847589 20102 leader_election.cc:304] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:07.848408 20341 raft_consensus.cc:2798] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:07.848927 20341 raft_consensus.cc:695] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:07.848946 20287 raft_consensus.cc:2463] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 2.
I20250109 21:09:07.849814 20341 consensus_queue.cc:237] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.856345 20033 catalog_manager.cc:5526] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 1 to 2, leader changed from 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195) to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:07.961745 20366 raft_consensus.cc:988] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4: : Instructing follower 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:07.962196 20341 raft_consensus.cc:1076] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Signalling peer 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:07.963542 20287 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "6860c8ea384449b88d6e61be4217d27f"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:53076
I20250109 21:09:07.963984 20287 raft_consensus.cc:491] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:07.964260 20287 raft_consensus.cc:3054] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:07.968344 20287 raft_consensus.cc:513] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.969833 20287 leader_election.cc:290] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 2 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:07.970481 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860c8ea384449b88d6e61be4217d27f" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:07.970798 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6860c8ea384449b88d6e61be4217d27f" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:07.971014 20138 raft_consensus.cc:3049] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:07.971282 20138 raft_consensus.cc:738] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:07.971283 20214 raft_consensus.cc:3054] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:07.971946 20138 consensus_queue.cc:260] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.972746 20138 raft_consensus.cc:3054] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:07.975868 20214 raft_consensus.cc:2463] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 2.
I20250109 21:09:07.977043 20252 leader_election.cc:304] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2; no voters:
I20250109 21:09:07.977677 20406 raft_consensus.cc:2798] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:07.977699 20138 raft_consensus.cc:2463] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 2.
I20250109 21:09:07.978269 20406 raft_consensus.cc:695] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 LEADER]: Becoming Leader. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:07.979059 20406 consensus_queue.cc:237] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:07.984505 20033 catalog_manager.cc:5526] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 reported cstate change: term changed from 1 to 2, leader changed from a1a553af342645968202750fe6789cc4 (127.19.136.193) to 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:07.995177 20340 raft_consensus.cc:988] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856: : Instructing follower a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:07.995582 20414 raft_consensus.cc:1076] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Signalling peer a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:07.996635 20138 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0"
dest_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:37402
I20250109 21:09:07.997025 20138 raft_consensus.cc:491] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:07.997267 20138 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.001320 20138 raft_consensus.cc:513] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.002620 20138 leader_election.cc:290] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 2 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:08.003365 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:08.003690 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:08.003813 20214 raft_consensus.cc:3049] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:08.004163 20287 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.004160 20214 raft_consensus.cc:738] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:08.004951 20214 consensus_queue.cc:260] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.005817 20214 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.008276 20287 raft_consensus.cc:2463] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 2.
I20250109 21:09:08.009158 20103 leader_election.cc:304] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:08.009791 20341 raft_consensus.cc:2798] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:08.009815 20214 raft_consensus.cc:2463] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 2.
I20250109 21:09:08.010380 20341 raft_consensus.cc:695] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:08.011196 20341 consensus_queue.cc:237] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.016574 20033 catalog_manager.cc:5526] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 1 to 2, leader changed from 07a3fea1966441738fb339af7620b856 (127.19.136.194) to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:08.087422 20366 raft_consensus.cc:988] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4: : Instructing follower 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:08.087852 20341 raft_consensus.cc:1076] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Signalling peer 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:08.089097 20214 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5"
dest_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:53094
I20250109 21:09:08.089521 20214 raft_consensus.cc:491] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:08.089771 20214 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.093793 20214 raft_consensus.cc:513] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.095577 20214 leader_election.cc:290] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 2 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:08.095968 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:08.096535 20138 raft_consensus.cc:3049] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:08.096873 20138 raft_consensus.cc:738] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:08.096901 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:08.097555 20287 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.097605 20138 consensus_queue.cc:260] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.098583 20138 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.101819 20287 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 2.
I20250109 21:09:08.102353 20138 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 2.
I20250109 21:09:08.102674 20179 leader_election.cc:304] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2; no voters:
I20250109 21:09:08.103403 20414 raft_consensus.cc:2798] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:08.103776 20414 raft_consensus.cc:695] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:08.104463 20414 consensus_queue.cc:237] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.109549 20033 catalog_manager.cc:5526] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 1 to 2, leader changed from a1a553af342645968202750fe6789cc4 (127.19.136.193) to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:08.210567 20371 raft_consensus.cc:988] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2: : Instructing follower 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:08.210969 20406 raft_consensus.cc:1076] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Signalling peer 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:08.212062 20214 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a"
dest_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:53106
I20250109 21:09:08.212502 20214 raft_consensus.cc:491] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:08.212774 20214 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.216789 20214 raft_consensus.cc:513] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.218194 20214 leader_election.cc:290] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 2 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:08.219076 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:08.219091 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:08.219616 20287 raft_consensus.cc:3049] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:08.219743 20138 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.219936 20287 raft_consensus.cc:738] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:08.220554 20287 consensus_queue.cc:260] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.221362 20287 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:08.224053 20138 raft_consensus.cc:2463] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 2.
I20250109 21:09:08.224889 20181 leader_election.cc:304] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:08.225607 20414 raft_consensus.cc:2798] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:08.225803 20287 raft_consensus.cc:2463] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 2.
I20250109 21:09:08.225961 20414 raft_consensus.cc:695] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:08.226729 20414 consensus_queue.cc:237] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:08.231861 20033 catalog_manager.cc:5526] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 1 to 2, leader changed from 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195) to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:08.288086 20287 raft_consensus.cc:1270] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.289276 20341 consensus_queue.cc:1035] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:08.296108 20214 raft_consensus.cc:1270] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.298015 20341 consensus_queue.cc:1035] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:08.410482 20214 raft_consensus.cc:1270] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.411649 20341 consensus_queue.cc:1035] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:08.419586 20287 raft_consensus.cc:1270] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.421726 20427 consensus_queue.cc:1035] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:09:08.427057 20214 raft_consensus.cc:1270] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.428251 20371 consensus_queue.cc:1035] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:08.438426 20138 raft_consensus.cc:1270] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.439994 20430 consensus_queue.cc:1035] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:08.645754 20287 raft_consensus.cc:1270] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.645757 20138 raft_consensus.cc:1270] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.647126 20414 consensus_queue.cc:1035] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:08.647034 20340 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:08.659811 20287 raft_consensus.cc:1270] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.660210 20138 raft_consensus.cc:1270] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:08.661732 20340 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:08.662719 20372 consensus_queue.cc:1035] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:10.868418 20003 auto_leader_rebalancer-test.cc:269] The leader distribution is
I20250109 21:09:10.869143 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:10.888701 20136 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4"
dest_uuid: "a1a553af342645968202750fe6789cc4"
mode: GRACEFUL
new_leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:53000
I20250109 21:09:10.889307 20136 raft_consensus.cc:604] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Received request to transfer leadership to TS 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:10.898173 20214 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5"
dest_uuid: "07a3fea1966441738fb339af7620b856"
mode: GRACEFUL
new_leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:59982
I20250109 21:09:10.898746 20214 raft_consensus.cc:604] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Received request to transfer leadership to TS 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:10.899863 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250109 21:09:10.900300 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:11.214109 20442 raft_consensus.cc:988] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4: : Instructing follower 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:11.214510 20399 raft_consensus.cc:1076] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Signalling peer 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:11.215767 20288 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:53076
I20250109 21:09:11.216166 20288 raft_consensus.cc:491] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:11.216418 20288 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:11.220546 20288 raft_consensus.cc:513] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:11.221865 20288 leader_election.cc:290] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 2 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), a1a553af342645968202750fe6789cc4 (127.19.136.193:46561)
I20250109 21:09:11.222514 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:11.222867 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:11.223102 20214 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:11.223407 20136 raft_consensus.cc:3049] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:11.223652 20136 raft_consensus.cc:738] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:11.224267 20136 consensus_queue.cc:260] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:11.225112 20136 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:11.227265 20214 raft_consensus.cc:2463] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 2.
I20250109 21:09:11.228132 20252 leader_election.cc:304] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2; no voters:
I20250109 21:09:11.228739 20430 raft_consensus.cc:2798] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:11.229189 20136 raft_consensus.cc:2463] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 2.
I20250109 21:09:11.229878 20430 raft_consensus.cc:695] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 LEADER]: Becoming Leader. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:11.230608 20430 consensus_queue.cc:237] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:11.236867 20032 catalog_manager.cc:5526] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 reported cstate change: term changed from 1 to 2, leader changed from a1a553af342645968202750fe6789cc4 (127.19.136.193) to 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:11.276067 20372 raft_consensus.cc:988] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856: : Instructing follower 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:11.276432 20372 raft_consensus.cc:1076] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Signalling peer 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:11.277577 20288 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:53084
I20250109 21:09:11.277966 20288 raft_consensus.cc:491] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:11.278198 20288 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:11.282120 20288 raft_consensus.cc:513] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:11.283578 20288 leader_election.cc:290] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 3 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:11.284220 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:11.284822 20136 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:11.284804 20214 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:11.285293 20214 raft_consensus.cc:3049] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:11.285540 20214 raft_consensus.cc:738] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:11.286098 20214 consensus_queue.cc:260] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:11.286990 20214 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:11.289093 20136 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 3.
I20250109 21:09:11.289852 20255 leader_election.cc:304] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:11.290405 20430 raft_consensus.cc:2798] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:11.290747 20430 raft_consensus.cc:695] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 LEADER]: Becoming Leader. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:11.291282 20214 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 3.
I20250109 21:09:11.291443 20430 consensus_queue.cc:237] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:11.297705 20032 catalog_manager.cc:5526] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 reported cstate change: term changed from 2 to 3, leader changed from 07a3fea1966441738fb339af7620b856 (127.19.136.194) to 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195). New cstate: current_term: 3 leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:11.670660 20136 raft_consensus.cc:1270] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:11.671838 20430 consensus_queue.cc:1035] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:11.682029 20214 raft_consensus.cc:1270] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:11.683348 20453 consensus_queue.cc:1035] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:11.728165 20214 raft_consensus.cc:1270] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:11.729204 20453 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:11.736040 20136 raft_consensus.cc:1270] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:11.737740 20430 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:11.901222 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:11.906077 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:11.906529 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:12.907289 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:12.911918 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:12.912284 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:13.913221 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:13.918526 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:13.918939 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:14.919598 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:14.924221 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:14.924554 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:15.925303 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:15.929836 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:15.930200 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:16.930871 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:16.935560 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:16.935918 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:17.936630 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:17.941514 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:17.941870 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:18.942888 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:18.948805 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:18.949128 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:19.949838 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:19.954807 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:19.955320 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:20.980497 20003 auto_leader_rebalancer-test.cc:288] The leader distribution is
I20250109 21:09:20.985109 20287 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
mode: GRACEFUL
new_leader_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:39600
I20250109 21:09:20.985860 20287 raft_consensus.cc:604] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 LEADER]: Received request to transfer leadership to TS 07a3fea1966441738fb339af7620b856
I20250109 21:09:20.990403 20136 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349"
dest_uuid: "a1a553af342645968202750fe6789cc4"
mode: GRACEFUL
new_leader_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:52992
I20250109 21:09:20.990900 20136 raft_consensus.cc:604] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Received request to transfer leadership to TS 07a3fea1966441738fb339af7620b856
I20250109 21:09:20.995232 20136 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9"
dest_uuid: "a1a553af342645968202750fe6789cc4"
mode: GRACEFUL
new_leader_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:52992
I20250109 21:09:20.995728 20136 raft_consensus.cc:604] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Received request to transfer leadership to TS 07a3fea1966441738fb339af7620b856
I20250109 21:09:20.999823 20136 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0"
dest_uuid: "a1a553af342645968202750fe6789cc4"
mode: GRACEFUL
new_leader_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:52992
I20250109 21:09:21.000274 20136 raft_consensus.cc:604] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Received request to transfer leadership to TS 07a3fea1966441738fb339af7620b856
I20250109 21:09:21.004307 20287 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
mode: GRACEFUL
new_leader_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:39600
I20250109 21:09:21.004776 20287 raft_consensus.cc:604] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 LEADER]: Received request to transfer leadership to TS 07a3fea1966441738fb339af7620b856
I20250109 21:09:21.049855 20463 raft_consensus.cc:988] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4: : Instructing follower 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.050336 20465 raft_consensus.cc:1076] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Signalling peer 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.051740 20215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349"
dest_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:53094
I20250109 21:09:21.052212 20215 raft_consensus.cc:491] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:21.052551 20215 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.057780 20215 raft_consensus.cc:513] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.059616 20215 leader_election.cc:290] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 3 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:21.060683 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:21.060671 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:21.061328 20287 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.061421 20136 raft_consensus.cc:3049] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:21.061756 20136 raft_consensus.cc:738] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:21.062394 20136 consensus_queue.cc:260] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.063464 20136 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.066810 20287 raft_consensus.cc:2463] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 3.
I20250109 21:09:21.068233 20179 leader_election.cc:304] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2; no voters:
I20250109 21:09:21.068994 20461 raft_consensus.cc:2798] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:21.069052 20136 raft_consensus.cc:2463] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 3.
I20250109 21:09:21.070123 20461 raft_consensus.cc:695] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:21.071038 20461 consensus_queue.cc:237] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.077458 20032 catalog_manager.cc:5526] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 2 to 3, leader changed from a1a553af342645968202750fe6789cc4 (127.19.136.193) to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 3 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:21.126820 20463 raft_consensus.cc:988] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4: : Instructing follower 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.127246 20465 raft_consensus.cc:1076] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Signalling peer 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.128549 20215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9"
dest_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:53094
I20250109 21:09:21.128993 20215 raft_consensus.cc:491] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:21.129251 20215 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:21.133656 20215 raft_consensus.cc:513] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.135110 20215 leader_election.cc:290] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 2 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:21.135979 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:21.136027 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:21.136675 20136 raft_consensus.cc:3049] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:21.136749 20287 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:21.136952 20136 raft_consensus.cc:738] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:21.137605 20136 consensus_queue.cc:260] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.138566 20136 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:21.141023 20287 raft_consensus.cc:2463] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 2.
I20250109 21:09:21.141916 20179 leader_election.cc:304] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2; no voters:
I20250109 21:09:21.142638 20461 raft_consensus.cc:2798] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:21.143117 20461 raft_consensus.cc:695] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:21.143965 20461 consensus_queue.cc:237] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.144587 20136 raft_consensus.cc:2463] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 2.
I20250109 21:09:21.150955 20032 catalog_manager.cc:5526] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 1 to 2, leader changed from a1a553af342645968202750fe6789cc4 (127.19.136.193) to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:21.232065 20463 raft_consensus.cc:988] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4: : Instructing follower 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.232452 20465 raft_consensus.cc:1076] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Signalling peer 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.233731 20215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0"
dest_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:53094
I20250109 21:09:21.234148 20215 raft_consensus.cc:491] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:21.234385 20215 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.238667 20215 raft_consensus.cc:513] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.240068 20215 leader_election.cc:290] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 3 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:21.241068 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:21.241068 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "88ba6d3a84814edabc5e283511f8b5f0" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:21.241781 20136 raft_consensus.cc:3049] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:21.242192 20136 raft_consensus.cc:738] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:21.241886 20287 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.242974 20136 consensus_queue.cc:260] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.245225 20136 raft_consensus.cc:3054] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.248924 20287 raft_consensus.cc:2463] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 3.
I20250109 21:09:21.249877 20179 leader_election.cc:304] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, 5495cca8eac74118baf4bfc5f667bbc2; no voters:
I20250109 21:09:21.250489 20461 raft_consensus.cc:2798] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:21.250862 20461 raft_consensus.cc:695] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:21.251874 20461 consensus_queue.cc:237] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.252492 20136 raft_consensus.cc:2463] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 3.
I20250109 21:09:21.258136 20032 catalog_manager.cc:5526] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 2 to 3, leader changed from a1a553af342645968202750fe6789cc4 (127.19.136.193) to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 3 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:21.271694 20462 raft_consensus.cc:988] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2: : Instructing follower 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.272163 20474 raft_consensus.cc:1076] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 LEADER]: Signalling peer 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.273515 20215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4"
dest_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:53106
I20250109 21:09:21.273932 20215 raft_consensus.cc:491] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:21.274211 20215 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.277968 20215 raft_consensus.cc:513] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:21.279213 20215 leader_election.cc:290] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 3 election: Requested vote from peers 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157), a1a553af342645968202750fe6789cc4 (127.19.136.193:46561)
I20250109 21:09:21.279999 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:21.280223 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35d7f8e48199430e9f6d10be73921ec4" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:21.280560 20287 raft_consensus.cc:3049] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:21.280735 20136 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.280884 20287 raft_consensus.cc:738] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:21.281579 20287 consensus_queue.cc:260] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:21.282775 20287 raft_consensus.cc:3054] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:21.287557 20136 raft_consensus.cc:2463] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 3.
I20250109 21:09:21.288599 20287 raft_consensus.cc:2463] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 3.
I20250109 21:09:21.288704 20181 leader_election.cc:304] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:21.289436 20461 raft_consensus.cc:2798] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:21.289836 20461 raft_consensus.cc:695] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:21.290556 20461 consensus_queue.cc:237] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } }
I20250109 21:09:21.296341 20032 catalog_manager.cc:5526] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 2 to 3, leader changed from 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195) to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 3 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:21.411310 20462 raft_consensus.cc:988] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2: : Instructing follower 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.411756 20474 raft_consensus.cc:1076] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 LEADER]: Signalling peer 07a3fea1966441738fb339af7620b856 to start an election
I20250109 21:09:21.412966 20215 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5"
dest_uuid: "07a3fea1966441738fb339af7620b856"
from {username='slave'} at 127.0.0.1:53106
I20250109 21:09:21.413393 20215 raft_consensus.cc:491] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:21.413650 20215 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:21.417520 20215 raft_consensus.cc:513] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.418759 20215 leader_election.cc:290] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 4 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:21.419675 20287 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:21.419643 20136 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "07a3fea1966441738fb339af7620b856" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:21.420253 20287 raft_consensus.cc:3049] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:09:21.420327 20136 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:21.420500 20287 raft_consensus.cc:738] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:21.421157 20287 consensus_queue.cc:260] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.421989 20287 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:21.424662 20136 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 4.
I20250109 21:09:21.425488 20181 leader_election.cc:304] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 07a3fea1966441738fb339af7620b856, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:21.426043 20287 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 07a3fea1966441738fb339af7620b856 in term 4.
I20250109 21:09:21.426113 20461 raft_consensus.cc:2798] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:09:21.426535 20461 raft_consensus.cc:695] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 4 LEADER]: Becoming Leader. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:21.427330 20461 consensus_queue.cc:237] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:21.433511 20032 catalog_manager.cc:5526] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 reported cstate change: term changed from 3 to 4, leader changed from 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195) to 07a3fea1966441738fb339af7620b856 (127.19.136.194). New cstate: current_term: 4 leader_uuid: "07a3fea1966441738fb339af7620b856" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:21.542937 20136 raft_consensus.cc:1270] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:21.544060 20461 consensus_queue.cc:1035] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:21.552168 20287 raft_consensus.cc:1270] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:21.553653 20461 consensus_queue.cc:1035] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:21.579854 20287 raft_consensus.cc:1270] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:21.580850 20461 consensus_queue.cc:1035] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:21.588239 20136 raft_consensus.cc:1270] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:21.589685 20461 consensus_queue.cc:1035] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:21.690958 20287 raft_consensus.cc:1270] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:21.692121 20483 consensus_queue.cc:1035] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:21.699859 20136 raft_consensus.cc:1270] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:21.701602 20466 consensus_queue.cc:1035] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:21.705659 20138 raft_consensus.cc:1270] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:21.708336 20466 consensus_queue.cc:1035] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:21.716830 20287 raft_consensus.cc:1270] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:21.718190 20483 consensus_queue.cc:1035] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:21.958302 20287 raft_consensus.cc:1270] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 4 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:21.959406 20483 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:09:21.967787 20136 raft_consensus.cc:1270] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 4 FOLLOWER]: Refusing update from remote peer 07a3fea1966441738fb339af7620b856: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:21.968818 20461 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:09:24.038694 20003 auto_leader_rebalancer-test.cc:303] The leader distribution is
I20250109 21:09:24.039467 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:24.046451 20215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9"
dest_uuid: "07a3fea1966441738fb339af7620b856"
mode: GRACEFUL
new_leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:59982
I20250109 21:09:24.047096 20215 raft_consensus.cc:604] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Received request to transfer leadership to TS 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:24.049446 20215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22"
dest_uuid: "07a3fea1966441738fb339af7620b856"
mode: GRACEFUL
new_leader_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:59982
I20250109 21:09:24.049928 20215 raft_consensus.cc:604] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Received request to transfer leadership to TS a1a553af342645968202750fe6789cc4
I20250109 21:09:24.051784 20215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5"
dest_uuid: "07a3fea1966441738fb339af7620b856"
mode: GRACEFUL
new_leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:59982
I20250109 21:09:24.052168 20215 raft_consensus.cc:604] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 4 LEADER]: Received request to transfer leadership to TS 5495cca8eac74118baf4bfc5f667bbc2
I20250109 21:09:24.054838 20215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349"
dest_uuid: "07a3fea1966441738fb339af7620b856"
mode: GRACEFUL
new_leader_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:59982
I20250109 21:09:24.055349 20215 raft_consensus.cc:604] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Received request to transfer leadership to TS a1a553af342645968202750fe6789cc4
I20250109 21:09:24.057139 20215 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a"
dest_uuid: "07a3fea1966441738fb339af7620b856"
mode: GRACEFUL
new_leader_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:59982
I20250109 21:09:24.057493 20215 raft_consensus.cc:604] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Received request to transfer leadership to TS a1a553af342645968202750fe6789cc4
I20250109 21:09:24.058249 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250109 21:09:24.058640 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:24.196447 20492 raft_consensus.cc:988] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856: : Instructing follower a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:24.197151 20466 raft_consensus.cc:1076] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Signalling peer a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:24.198498 20136 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a"
dest_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:37402
I20250109 21:09:24.198982 20136 raft_consensus.cc:491] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:24.199290 20136 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:24.204419 20136 raft_consensus.cc:513] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.206452 20136 leader_election.cc:290] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 3 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:24.207348 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:24.207695 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6e31d619e85499ebe76d5fd3807ee0a" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:24.207986 20215 raft_consensus.cc:3049] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:24.208196 20288 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:24.208261 20215 raft_consensus.cc:738] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:24.208905 20215 consensus_queue.cc:260] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.209810 20215 raft_consensus.cc:3054] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:24.212545 20288 raft_consensus.cc:2463] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 3.
I20250109 21:09:24.213629 20103 leader_election.cc:304] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:24.214373 20215 raft_consensus.cc:2463] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 3.
I20250109 21:09:24.215265 20493 raft_consensus.cc:2798] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:24.216226 20493 raft_consensus.cc:695] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 3 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:24.217031 20493 consensus_queue.cc:237] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.223533 20031 catalog_manager.cc:5526] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 2 to 3, leader changed from 07a3fea1966441738fb339af7620b856 (127.19.136.194) to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:24.252701 20466 raft_consensus.cc:988] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856: : Instructing follower a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:24.253108 20466 raft_consensus.cc:1076] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Signalling peer a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:24.254380 20138 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22"
dest_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:37402
I20250109 21:09:24.254854 20138 raft_consensus.cc:491] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:24.255191 20138 raft_consensus.cc:3054] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:24.260380 20138 raft_consensus.cc:513] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.261739 20138 leader_election.cc:290] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 2 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:24.262408 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:24.262723 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fff237d72c148e2b13859ace234ce22" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:24.262966 20215 raft_consensus.cc:3049] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:24.263240 20215 raft_consensus.cc:738] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:24.263248 20288 raft_consensus.cc:3054] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:24.264041 20215 consensus_queue.cc:260] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.264989 20215 raft_consensus.cc:3054] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:24.267339 20288 raft_consensus.cc:2463] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 2.
I20250109 21:09:24.268158 20103 leader_election.cc:304] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:24.268900 20493 raft_consensus.cc:2798] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:24.269254 20493 raft_consensus.cc:695] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:24.269264 20215 raft_consensus.cc:2463] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 2.
I20250109 21:09:24.270133 20493 consensus_queue.cc:237] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.276722 20031 catalog_manager.cc:5526] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 1 to 2, leader changed from 07a3fea1966441738fb339af7620b856 (127.19.136.194) to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:24.415854 20492 raft_consensus.cc:988] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856: : Instructing follower 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:24.416335 20466 raft_consensus.cc:1076] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Signalling peer 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:24.417515 20288 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:53084
I20250109 21:09:24.417951 20288 raft_consensus.cc:491] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:24.418191 20288 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:24.421957 20288 raft_consensus.cc:513] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.423717 20288 leader_election.cc:290] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 3 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:24.424635 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:24.424613 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "174eb905bb344a36b609bdfc743e54b9" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:24.425258 20215 raft_consensus.cc:3049] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:24.425319 20138 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:24.425660 20215 raft_consensus.cc:738] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:24.426395 20215 consensus_queue.cc:260] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.427525 20215 raft_consensus.cc:3054] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:24.431044 20138 raft_consensus.cc:2463] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 3.
I20250109 21:09:24.432106 20255 leader_election.cc:304] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:24.432830 20474 raft_consensus.cc:2798] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:24.432780 20215 raft_consensus.cc:2463] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 3.
I20250109 21:09:24.434103 20474 raft_consensus.cc:695] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 LEADER]: Becoming Leader. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:24.434891 20474 consensus_queue.cc:237] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.440865 20031 catalog_manager.cc:5526] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 reported cstate change: term changed from 2 to 3, leader changed from 07a3fea1966441738fb339af7620b856 (127.19.136.194) to 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195). New cstate: current_term: 3 leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:24.476383 20492 raft_consensus.cc:988] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856: : Instructing follower 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:24.476789 20466 raft_consensus.cc:1076] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 4 LEADER]: Signalling peer 5495cca8eac74118baf4bfc5f667bbc2 to start an election
I20250109 21:09:24.477945 20288 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5"
dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
from {username='slave'} at 127.0.0.1:53084
I20250109 21:09:24.478331 20288 raft_consensus.cc:491] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:24.478581 20288 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 4 FOLLOWER]: Advancing to term 5
I20250109 21:09:24.482396 20288 raft_consensus.cc:513] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.483752 20288 leader_election.cc:290] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 5 election: Requested vote from peers a1a553af342645968202750fe6789cc4 (127.19.136.193:46561), 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165)
I20250109 21:09:24.484545 20138 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "a1a553af342645968202750fe6789cc4"
I20250109 21:09:24.484730 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b454cb03259b438c80f2cb7ac2e99aa5" candidate_uuid: "5495cca8eac74118baf4bfc5f667bbc2" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:24.485085 20138 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 4 FOLLOWER]: Advancing to term 5
I20250109 21:09:24.485172 20215 raft_consensus.cc:3049] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 4 LEADER]: Stepping down as leader of term 4
I20250109 21:09:24.485464 20215 raft_consensus.cc:738] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:24.486150 20215 consensus_queue.cc:260] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.487308 20215 raft_consensus.cc:3054] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 4 FOLLOWER]: Advancing to term 5
I20250109 21:09:24.490736 20138 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 5.
I20250109 21:09:24.491626 20255 leader_election.cc:304] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:24.492362 20474 raft_consensus.cc:2798] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 5 FOLLOWER]: Leader election won for term 5
I20250109 21:09:24.492730 20474 raft_consensus.cc:695] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 5 LEADER]: Becoming Leader. State: Replica: 5495cca8eac74118baf4bfc5f667bbc2, State: Running, Role: LEADER
I20250109 21:09:24.492846 20215 raft_consensus.cc:2463] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5495cca8eac74118baf4bfc5f667bbc2 in term 5.
I20250109 21:09:24.493516 20474 consensus_queue.cc:237] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.499253 20031 catalog_manager.cc:5526] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 reported cstate change: term changed from 4 to 5, leader changed from 07a3fea1966441738fb339af7620b856 (127.19.136.194) to 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195). New cstate: current_term: 5 leader_uuid: "5495cca8eac74118baf4bfc5f667bbc2" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:24.541622 20492 raft_consensus.cc:988] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856: : Instructing follower a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:24.542058 20466 raft_consensus.cc:1076] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Signalling peer a1a553af342645968202750fe6789cc4 to start an election
I20250109 21:09:24.543358 20138 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349"
dest_uuid: "a1a553af342645968202750fe6789cc4"
from {username='slave'} at 127.0.0.1:37402
I20250109 21:09:24.543732 20138 raft_consensus.cc:491] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:24.543956 20138 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:24.547724 20138 raft_consensus.cc:513] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.549131 20138 leader_election.cc:290] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 4 election: Requested vote from peers 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165), 5495cca8eac74118baf4bfc5f667bbc2 (127.19.136.195:45157)
I20250109 21:09:24.549772 20215 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "07a3fea1966441738fb339af7620b856"
I20250109 21:09:24.550222 20288 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bcbe2796a0194d17971ad21c4f3b8349" candidate_uuid: "a1a553af342645968202750fe6789cc4" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "5495cca8eac74118baf4bfc5f667bbc2"
I20250109 21:09:24.550489 20215 raft_consensus.cc:3049] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:09:24.550797 20288 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:24.550829 20215 raft_consensus.cc:738] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 07a3fea1966441738fb339af7620b856, State: Running, Role: LEADER
I20250109 21:09:24.551600 20215 consensus_queue.cc:260] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.552443 20215 raft_consensus.cc:3054] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:24.554842 20288 raft_consensus.cc:2463] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 4.
I20250109 21:09:24.555676 20103 leader_election.cc:304] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5495cca8eac74118baf4bfc5f667bbc2, a1a553af342645968202750fe6789cc4; no voters:
I20250109 21:09:24.556202 20215 raft_consensus.cc:2463] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate a1a553af342645968202750fe6789cc4 in term 4.
I20250109 21:09:24.556277 20493 raft_consensus.cc:2798] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:09:24.556694 20493 raft_consensus.cc:695] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 4 LEADER]: Becoming Leader. State: Replica: a1a553af342645968202750fe6789cc4, State: Running, Role: LEADER
I20250109 21:09:24.557453 20493 consensus_queue.cc:237] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } }
I20250109 21:09:24.563146 20031 catalog_manager.cc:5526] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 reported cstate change: term changed from 3 to 4, leader changed from 07a3fea1966441738fb339af7620b856 (127.19.136.194) to a1a553af342645968202750fe6789cc4 (127.19.136.193). New cstate: current_term: 4 leader_uuid: "a1a553af342645968202750fe6789cc4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:24.783332 20288 raft_consensus.cc:1270] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:24.784359 20493 consensus_queue.cc:1035] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:24.790789 20288 raft_consensus.cc:1270] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:24.792295 20494 consensus_queue.cc:1035] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:09:24.796783 20215 raft_consensus.cc:1270] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:24.798789 20493 consensus_queue.cc:1035] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:24.804454 20214 raft_consensus.cc:1270] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:24.805855 20493 consensus_queue.cc:1035] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:24.841325 20138 raft_consensus.cc:1270] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:24.842633 20474 consensus_queue.cc:1035] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:24.850963 20214 raft_consensus.cc:1270] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:24.852192 20474 consensus_queue.cc:1035] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:24.957360 20287 raft_consensus.cc:1270] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 4 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:24.958489 20493 consensus_queue.cc:1035] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5495cca8eac74118baf4bfc5f667bbc2" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 45157 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:09:24.966928 20214 raft_consensus.cc:1270] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 4 FOLLOWER]: Refusing update from remote peer a1a553af342645968202750fe6789cc4: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:24.968374 20509 consensus_queue.cc:1035] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:09:25.039860 20214 raft_consensus.cc:1270] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 5 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250109 21:09:25.040807 20474 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "07a3fea1966441738fb339af7620b856" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 43165 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:09:25.048683 20138 raft_consensus.cc:1270] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 5 FOLLOWER]: Refusing update from remote peer 5495cca8eac74118baf4bfc5f667bbc2: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250109 21:09:25.050375 20501 consensus_queue.cc:1035] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [LEADER]: Connected to new peer: Peer: permanent_uuid: "a1a553af342645968202750fe6789cc4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46561 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:09:25.059427 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:25.064793 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:25.065137 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:26.065819 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:26.070499 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:26.070883 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:27.071671 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:27.076633 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:27.077021 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:28.077755 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:28.082347 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:28.082720 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:29.083454 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:29.088153 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:29.088515 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:30.089355 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:30.094534 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:30.094851 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:31.095569 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:31.100997 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:31.101300 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:32.101933 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:32.107440 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:32.107753 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:33.108525 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:33.114310 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:33.114704 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:34.140316 20003 auto_leader_rebalancer-test.cc:314] The leader distribution is
I20250109 21:09:34.140969 20003 tablet_server.cc:178] TabletServer@127.19.136.193:0 shutting down...
W20250109 21:09:34.168306 20181 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250109 21:09:34.168437 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:09:34.169245 20003 tablet_replica.cc:331] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.170156 20003 raft_consensus.cc:2238] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.171265 20003 raft_consensus.cc:2267] T bcbe2796a0194d17971ad21c4f3b8349 P a1a553af342645968202750fe6789cc4 [term 4 FOLLOWER]: Raft consensus is shut down!
W20250109 21:09:34.171339 20181 consensus_peers.cc:487] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 -> Peer a1a553af342645968202750fe6789cc4 (127.19.136.193:46561): Couldn't send request to peer a1a553af342645968202750fe6789cc4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:09:34.173599 20003 tablet_replica.cc:331] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.174109 20003 raft_consensus.cc:2238] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.174553 20003 raft_consensus.cc:2267] T 174eb905bb344a36b609bdfc743e54b9 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.176352 20003 tablet_replica.cc:331] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.176924 20003 raft_consensus.cc:2238] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.177433 20003 raft_consensus.cc:2267] T 6860c8ea384449b88d6e61be4217d27f P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.179505 20003 tablet_replica.cc:331] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.179961 20003 raft_consensus.cc:2238] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.180337 20003 raft_consensus.cc:2267] T 88ba6d3a84814edabc5e283511f8b5f0 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.182334 20003 tablet_replica.cc:331] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.182977 20003 raft_consensus.cc:2238] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.184016 20003 raft_consensus.cc:2267] T e6e31d619e85499ebe76d5fd3807ee0a P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.185547 20003 tablet_replica.cc:331] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.186002 20003 raft_consensus.cc:2238] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.186371 20003 raft_consensus.cc:2267] T c47153f0561d4b60bbbbea6e0fcdefd9 P a1a553af342645968202750fe6789cc4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.188053 20003 tablet_replica.cc:331] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.188526 20003 raft_consensus.cc:2238] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 5 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.188978 20003 raft_consensus.cc:2267] T b454cb03259b438c80f2cb7ac2e99aa5 P a1a553af342645968202750fe6789cc4 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.190471 20003 tablet_replica.cc:331] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.190934 20003 raft_consensus.cc:2238] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.191615 20003 raft_consensus.cc:2267] T 8fff237d72c148e2b13859ace234ce22 P a1a553af342645968202750fe6789cc4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.193593 20003 tablet_replica.cc:331] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4: stopping tablet replica
I20250109 21:09:34.194193 20003 raft_consensus.cc:2238] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.194680 20003 raft_consensus.cc:2267] T 35d7f8e48199430e9f6d10be73921ec4 P a1a553af342645968202750fe6789cc4 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:09:34.283659 20181 consensus_peers.cc:487] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 -> Peer a1a553af342645968202750fe6789cc4 (127.19.136.193:46561): Couldn't send request to peer a1a553af342645968202750fe6789cc4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:09:34.284608 20255 consensus_peers.cc:487] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 -> Peer a1a553af342645968202750fe6789cc4 (127.19.136.193:46561): Couldn't send request to peer a1a553af342645968202750fe6789cc4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:09:34.292796 20003 tablet_server.cc:195] TabletServer@127.19.136.193:0 shutdown complete.
I20250109 21:09:34.310637 20003 tablet_server.cc:178] TabletServer@127.19.136.194:0 shutting down...
I20250109 21:09:34.338994 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:09:34.339612 20003 tablet_replica.cc:331] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.340200 20003 raft_consensus.cc:2238] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.340642 20003 raft_consensus.cc:2267] T 6860c8ea384449b88d6e61be4217d27f P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.342428 20003 tablet_replica.cc:331] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.342903 20003 raft_consensus.cc:2238] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.343338 20003 raft_consensus.cc:2267] T 174eb905bb344a36b609bdfc743e54b9 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.344898 20003 tablet_replica.cc:331] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.345336 20003 raft_consensus.cc:2238] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.346064 20003 raft_consensus.cc:2267] T c47153f0561d4b60bbbbea6e0fcdefd9 P 07a3fea1966441738fb339af7620b856 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.347643 20003 tablet_replica.cc:331] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.348105 20003 raft_consensus.cc:2238] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 5 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.348521 20003 raft_consensus.cc:2267] T b454cb03259b438c80f2cb7ac2e99aa5 P 07a3fea1966441738fb339af7620b856 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.350055 20003 tablet_replica.cc:331] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.350483 20003 raft_consensus.cc:2238] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.350898 20003 raft_consensus.cc:2267] T e6e31d619e85499ebe76d5fd3807ee0a P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.352416 20003 tablet_replica.cc:331] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.352859 20003 raft_consensus.cc:2238] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.353617 20003 raft_consensus.cc:2267] T 88ba6d3a84814edabc5e283511f8b5f0 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.355123 20003 tablet_replica.cc:331] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.355533 20003 raft_consensus.cc:2238] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.356237 20003 raft_consensus.cc:2267] T 35d7f8e48199430e9f6d10be73921ec4 P 07a3fea1966441738fb339af7620b856 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.357954 20003 tablet_replica.cc:331] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.358373 20003 raft_consensus.cc:2238] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.358716 20003 raft_consensus.cc:2267] T 8fff237d72c148e2b13859ace234ce22 P 07a3fea1966441738fb339af7620b856 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.360162 20003 tablet_replica.cc:331] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856: stopping tablet replica
I20250109 21:09:34.360550 20003 raft_consensus.cc:2238] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.360935 20003 raft_consensus.cc:2267] T bcbe2796a0194d17971ad21c4f3b8349 P 07a3fea1966441738fb339af7620b856 [term 4 FOLLOWER]: Raft consensus is shut down!
W20250109 21:09:34.378160 20255 consensus_peers.cc:487] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 -> Peer a1a553af342645968202750fe6789cc4 (127.19.136.193:46561): Couldn't send request to peer a1a553af342645968202750fe6789cc4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46561: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:09:34.387501 20003 tablet_server.cc:195] TabletServer@127.19.136.194:0 shutdown complete.
I20250109 21:09:34.404289 20003 tablet_server.cc:178] TabletServer@127.19.136.195:0 shutting down...
I20250109 21:09:34.428680 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:09:34.429427 20003 tablet_replica.cc:331] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.430162 20003 raft_consensus.cc:2238] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.430709 20003 raft_consensus.cc:2267] T 8fff237d72c148e2b13859ace234ce22 P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.432849 20003 tablet_replica.cc:331] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.433429 20003 raft_consensus.cc:2238] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.433897 20003 raft_consensus.cc:2267] T 35d7f8e48199430e9f6d10be73921ec4 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:09:34.435451 20252 consensus_peers.cc:487] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 -> Peer 07a3fea1966441738fb339af7620b856 (127.19.136.194:43165): Couldn't send request to peer 07a3fea1966441738fb339af7620b856. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:43165: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:09:34.435892 20003 tablet_replica.cc:331] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.436458 20003 raft_consensus.cc:2238] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.436864 20003 raft_consensus.cc:2267] T c47153f0561d4b60bbbbea6e0fcdefd9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.438759 20003 tablet_replica.cc:331] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.439240 20003 raft_consensus.cc:2238] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 5 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.439980 20003 raft_consensus.cc:2267] T b454cb03259b438c80f2cb7ac2e99aa5 P 5495cca8eac74118baf4bfc5f667bbc2 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.441545 20003 tablet_replica.cc:331] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.441980 20003 raft_consensus.cc:2238] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.442677 20003 raft_consensus.cc:2267] T 6860c8ea384449b88d6e61be4217d27f P 5495cca8eac74118baf4bfc5f667bbc2 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.444144 20003 tablet_replica.cc:331] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.444535 20003 raft_consensus.cc:2238] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.445120 20003 raft_consensus.cc:2267] T 174eb905bb344a36b609bdfc743e54b9 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.446691 20003 tablet_replica.cc:331] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.447209 20003 raft_consensus.cc:2238] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.447546 20003 raft_consensus.cc:2267] T 88ba6d3a84814edabc5e283511f8b5f0 P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.448941 20003 tablet_replica.cc:331] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.449312 20003 raft_consensus.cc:2238] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.449702 20003 raft_consensus.cc:2267] T e6e31d619e85499ebe76d5fd3807ee0a P 5495cca8eac74118baf4bfc5f667bbc2 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.451061 20003 tablet_replica.cc:331] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2: stopping tablet replica
I20250109 21:09:34.451412 20003 raft_consensus.cc:2238] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:09:34.451802 20003 raft_consensus.cc:2267] T bcbe2796a0194d17971ad21c4f3b8349 P 5495cca8eac74118baf4bfc5f667bbc2 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.477327 20003 tablet_server.cc:195] TabletServer@127.19.136.195:0 shutdown complete.
I20250109 21:09:34.494263 20003 master.cc:537] Master@127.19.136.254:46199 shutting down...
I20250109 21:09:34.686458 20003 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:09:34.687068 20003 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:09:34.687371 20003 tablet_replica.cc:331] T 00000000000000000000000000000000 P 154408f3019e443ea208fc980d58c2af: stopping tablet replica
I20250109 21:09:34.707500 20003 master.cc:559] Master@127.19.136.254:46199 shutdown complete.
07a3fea1966441738fb339af7620b856 4
5495cca8eac74118baf4bfc5f667bbc2 1
a1a553af342645968202750fe6789cc4 4
07a3fea1966441738fb339af7620b856 3
5495cca8eac74118baf4bfc5f667bbc2 3
a1a553af342645968202750fe6789cc4 3
07a3fea1966441738fb339af7620b856 8
5495cca8eac74118baf4bfc5f667bbc2 1
a1a553af342645968202750fe6789cc4 0
07a3fea1966441738fb339af7620b856 3
5495cca8eac74118baf4bfc5f667bbc2 3
a1a553af342645968202750fe6789cc4 3
[ OK ] LeaderRebalancerTest.FunctionalTestForDivided (31107 ms)
[ RUN ] LeaderRebalancerTest.FunctionalTestForNotDivided
I20250109 21:09:34.744272 20003 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.136.254:39205
I20250109 21:09:34.745333 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:09:34.751235 20527 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:34.751760 20528 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:34.752414 20530 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:34.753037 20003 server_base.cc:1034] running on GCE node
I20250109 21:09:34.753918 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:09:34.754112 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:09:34.754282 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736456974754246 us; error 0 us; skew 500 ppm
I20250109 21:09:34.754786 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:09:34.761379 20003 webserver.cc:458] Webserver started at http://127.19.136.254:36441/ using document root <none> and password file <none>
I20250109 21:09:34.761862 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:09:34.762032 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:09:34.762271 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:09:34.763450 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/master-0-root/instance:
uuid: "efff753480c14485a5c541f66c4c8ced"
format_stamp: "Formatted at 2025-01-09 21:09:34 on dist-test-slave-sc47"
I20250109 21:09:34.768298 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250109 21:09:34.771387 20535 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:34.772050 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:09:34.772293 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/master-0-root
uuid: "efff753480c14485a5c541f66c4c8ced"
format_stamp: "Formatted at 2025-01-09 21:09:34 on dist-test-slave-sc47"
I20250109 21:09:34.772554 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:09:34.797935 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:09:34.799189 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:09:34.835269 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.254:39205
I20250109 21:09:34.835364 20586 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.254:39205 every 8 connection(s)
I20250109 21:09:34.839496 20587 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:34.850622 20587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced: Bootstrap starting.
I20250109 21:09:34.854750 20587 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:34.858417 20587 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced: No bootstrap required, opened a new log
I20250109 21:09:34.860246 20587 raft_consensus.cc:357] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efff753480c14485a5c541f66c4c8ced" member_type: VOTER }
I20250109 21:09:34.860628 20587 raft_consensus.cc:383] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:34.860800 20587 raft_consensus.cc:738] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: efff753480c14485a5c541f66c4c8ced, State: Initialized, Role: FOLLOWER
I20250109 21:09:34.861181 20587 consensus_queue.cc:260] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efff753480c14485a5c541f66c4c8ced" member_type: VOTER }
I20250109 21:09:34.861532 20587 raft_consensus.cc:397] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250109 21:09:34.861706 20587 raft_consensus.cc:491] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250109 21:09:34.861892 20587 raft_consensus.cc:3054] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:34.865164 20587 raft_consensus.cc:513] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efff753480c14485a5c541f66c4c8ced" member_type: VOTER }
I20250109 21:09:34.865556 20587 leader_election.cc:304] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: efff753480c14485a5c541f66c4c8ced; no voters:
I20250109 21:09:34.866464 20587 leader_election.cc:290] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [CANDIDATE]: Term 1 election: Requested vote from peers
I20250109 21:09:34.866793 20590 raft_consensus.cc:2798] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:34.868032 20590 raft_consensus.cc:695] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 1 LEADER]: Becoming Leader. State: Replica: efff753480c14485a5c541f66c4c8ced, State: Running, Role: LEADER
I20250109 21:09:34.868717 20590 consensus_queue.cc:237] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efff753480c14485a5c541f66c4c8ced" member_type: VOTER }
I20250109 21:09:34.869304 20587 sys_catalog.cc:564] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [sys.catalog]: configured and running, proceeding with master startup.
I20250109 21:09:34.873754 20592 sys_catalog.cc:455] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [sys.catalog]: SysCatalogTable state changed. Reason: New leader efff753480c14485a5c541f66c4c8ced. Latest consensus state: current_term: 1 leader_uuid: "efff753480c14485a5c541f66c4c8ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efff753480c14485a5c541f66c4c8ced" member_type: VOTER } }
I20250109 21:09:34.874385 20592 sys_catalog.cc:458] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [sys.catalog]: This master's current role is: LEADER
I20250109 21:09:34.874466 20591 sys_catalog.cc:455] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "efff753480c14485a5c541f66c4c8ced" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "efff753480c14485a5c541f66c4c8ced" member_type: VOTER } }
I20250109 21:09:34.875094 20591 sys_catalog.cc:458] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [sys.catalog]: This master's current role is: LEADER
I20250109 21:09:34.876305 20599 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250109 21:09:34.880882 20599 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250109 21:09:34.882992 20003 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250109 21:09:34.888492 20599 catalog_manager.cc:1348] Generated new cluster ID: 18c33ceee2a5404bb7bce0e91c3e4b6a
I20250109 21:09:34.888700 20599 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250109 21:09:34.916738 20599 catalog_manager.cc:1371] Generated new certificate authority record
I20250109 21:09:34.917860 20599 catalog_manager.cc:1505] Loading token signing keys...
I20250109 21:09:34.933280 20599 catalog_manager.cc:5899] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced: Generated new TSK 0
I20250109 21:09:34.933745 20599 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250109 21:09:34.949416 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:09:34.955575 20608 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:34.956424 20609 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:34.957576 20003 server_base.cc:1034] running on GCE node
W20250109 21:09:34.958175 20611 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:34.958945 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:09:34.959131 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:09:34.959249 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736456974959238 us; error 0 us; skew 500 ppm
I20250109 21:09:34.959694 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:09:34.961848 20003 webserver.cc:458] Webserver started at http://127.19.136.193:37079/ using document root <none> and password file <none>
I20250109 21:09:34.962304 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:09:34.962456 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:09:34.962673 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:09:34.963675 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-0-root/instance:
uuid: "670b1b7fdd4640d68f75d69832d02eb1"
format_stamp: "Formatted at 2025-01-09 21:09:34 on dist-test-slave-sc47"
I20250109 21:09:34.967743 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20250109 21:09:34.970690 20616 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:34.971395 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:09:34.971632 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-0-root
uuid: "670b1b7fdd4640d68f75d69832d02eb1"
format_stamp: "Formatted at 2025-01-09 21:09:34 on dist-test-slave-sc47"
I20250109 21:09:34.971879 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:09:34.990608 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:09:34.991773 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:09:34.993120 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:09:34.995143 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:09:34.995322 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:34.995512 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:09:34.995651 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:35.031920 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.193:37345
I20250109 21:09:35.032018 20680 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.193:37345 every 8 connection(s)
I20250109 21:09:35.036114 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:09:35.043952 20685 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:35.044526 20686 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:35.047668 20003 server_base.cc:1034] running on GCE node
W20250109 21:09:35.048534 20688 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:35.049007 20681 heartbeater.cc:346] Connected to a master server at 127.19.136.254:39205
I20250109 21:09:35.049291 20681 heartbeater.cc:463] Registering TS with master...
I20250109 21:09:35.049345 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:09:35.049561 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:09:35.049715 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736456975049699 us; error 0 us; skew 500 ppm
I20250109 21:09:35.049939 20681 heartbeater.cc:510] Master 127.19.136.254:39205 requested a full tablet report, sending...
I20250109 21:09:35.050212 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:09:35.051774 20552 ts_manager.cc:194] Registered new tserver with Master: 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345)
I20250109 21:09:35.052685 20003 webserver.cc:458] Webserver started at http://127.19.136.194:40987/ using document root <none> and password file <none>
I20250109 21:09:35.053287 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:09:35.053483 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:09:35.053761 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:09:35.053871 20552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52542
I20250109 21:09:35.055140 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-1-root/instance:
uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
format_stamp: "Formatted at 2025-01-09 21:09:35 on dist-test-slave-sc47"
I20250109 21:09:35.059029 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.003s user 0.004s sys 0.000s
I20250109 21:09:35.061800 20693 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:35.062490 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250109 21:09:35.062759 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-1-root
uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
format_stamp: "Formatted at 2025-01-09 21:09:35 on dist-test-slave-sc47"
I20250109 21:09:35.063060 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:09:35.095474 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:09:35.096693 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:09:35.098101 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:09:35.100157 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:09:35.100339 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:35.100541 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:09:35.100695 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:35.137354 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.194:34583
I20250109 21:09:35.137447 20756 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.194:34583 every 8 connection(s)
I20250109 21:09:35.141837 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:09:35.149525 20760 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:35.149921 20761 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:09:35.151274 20763 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:09:35.152439 20003 server_base.cc:1034] running on GCE node
I20250109 21:09:35.153069 20757 heartbeater.cc:346] Connected to a master server at 127.19.136.254:39205
I20250109 21:09:35.153328 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20250109 21:09:35.153443 20757 heartbeater.cc:463] Registering TS with master...
W20250109 21:09:35.153582 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:09:35.153800 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736456975153781 us; error 0 us; skew 500 ppm
I20250109 21:09:35.154279 20757 heartbeater.cc:510] Master 127.19.136.254:39205 requested a full tablet report, sending...
I20250109 21:09:35.154522 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:09:35.156282 20552 ts_manager.cc:194] Registered new tserver with Master: 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:35.157222 20003 webserver.cc:458] Webserver started at http://127.19.136.195:46721/ using document root <none> and password file <none>
I20250109 21:09:35.157689 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:09:35.157687 20552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52552
I20250109 21:09:35.158030 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:09:35.158298 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:09:35.159528 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-2-root/instance:
uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
format_stamp: "Formatted at 2025-01-09 21:09:35 on dist-test-slave-sc47"
I20250109 21:09:35.163585 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.002s
I20250109 21:09:35.166420 20768 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:35.167173 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250109 21:09:35.167428 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-2-root
uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
format_stamp: "Formatted at 2025-01-09 21:09:35 on dist-test-slave-sc47"
I20250109 21:09:35.167675 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.FunctionalTestForNotDivided.1736456943481041-20003-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:09:35.184988 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:09:35.185971 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:09:35.187265 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:09:35.189229 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:09:35.189397 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:35.189615 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:09:35.189750 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:09:35.226388 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.195:40239
I20250109 21:09:35.226477 20830 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.195:40239 every 8 connection(s)
I20250109 21:09:35.238289 20831 heartbeater.cc:346] Connected to a master server at 127.19.136.254:39205
I20250109 21:09:35.238600 20831 heartbeater.cc:463] Registering TS with master...
I20250109 21:09:35.239176 20831 heartbeater.cc:510] Master 127.19.136.254:39205 requested a full tablet report, sending...
I20250109 21:09:35.240671 20552 ts_manager.cc:194] Registered new tserver with Master: e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:35.241153 20003 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.011852691s
I20250109 21:09:35.241849 20552 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:52566
I20250109 21:09:35.243327 20003 test_util.cc:274] Using random seed: 1697470505
I20250109 21:09:35.262447 20552 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:52574:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s""\004\001\000\314\314\314\014\004\001\000\230\231\231\031\004\001\000dff&\004\001\0000333\004\001\000\374\377\377?\004\001\000\310\314\314L\004\001\000\224\231\231Y\004\001\000`fff\004\001\000,33s"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250109 21:09:35.265132 20552 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250109 21:09:35.349447 20796 tablet_service.cc:1467] Processing CreateTablet for tablet 04dc56331ff84f7e80857e713422faf3 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION VALUES < 214748364
I20250109 21:09:35.350966 20796 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dc56331ff84f7e80857e713422faf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.351117 20795 tablet_service.cc:1467] Processing CreateTablet for tablet 2b14f572654f4e7d92a34209e01df632 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20250109 21:09:35.352483 20795 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14f572654f4e7d92a34209e01df632. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.352563 20721 tablet_service.cc:1467] Processing CreateTablet for tablet 04dc56331ff84f7e80857e713422faf3 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION VALUES < 214748364
I20250109 21:09:35.353863 20721 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dc56331ff84f7e80857e713422faf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.356271 20718 tablet_service.cc:1467] Processing CreateTablet for tablet 4adc5f2899a14e1c95ee79782aa1eaa5 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20250109 21:09:35.356608 20793 tablet_service.cc:1467] Processing CreateTablet for tablet 4adc5f2899a14e1c95ee79782aa1eaa5 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20250109 21:09:35.357600 20718 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adc5f2899a14e1c95ee79782aa1eaa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.357836 20793 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adc5f2899a14e1c95ee79782aa1eaa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.359237 20789 tablet_service.cc:1467] Processing CreateTablet for tablet d8c47ba51cf3462697faafec02851e47 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20250109 21:09:35.360468 20789 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c47ba51cf3462697faafec02851e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.371629 20716 tablet_service.cc:1467] Processing CreateTablet for tablet 1af768b40f134f1a928ae54f64796392 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20250109 21:09:35.372951 20716 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af768b40f134f1a928ae54f64796392. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.373997 20714 tablet_service.cc:1467] Processing CreateTablet for tablet d8c47ba51cf3462697faafec02851e47 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20250109 21:09:35.375306 20714 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c47ba51cf3462697faafec02851e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.364055 20713 tablet_service.cc:1467] Processing CreateTablet for tablet 743d96d61f80409e9d57a2f42370c07a (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20250109 21:09:35.376322 20713 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743d96d61f80409e9d57a2f42370c07a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.364439 20790 tablet_service.cc:1467] Processing CreateTablet for tablet 108b9ff6a92049a1824c85dc4a2635f5 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20250109 21:09:35.377372 20790 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108b9ff6a92049a1824c85dc4a2635f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.366470 20787 tablet_service.cc:1467] Processing CreateTablet for tablet d387b5362a59432b99d59665897882d0 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20250109 21:09:35.363353 20792 tablet_service.cc:1467] Processing CreateTablet for tablet 8b39a53ae62547029a75aa38767f4414 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20250109 21:09:35.380337 20787 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d387b5362a59432b99d59665897882d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.362274 20791 tablet_service.cc:1467] Processing CreateTablet for tablet 1af768b40f134f1a928ae54f64796392 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20250109 21:09:35.381886 20791 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af768b40f134f1a928ae54f64796392. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.383239 20792 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b39a53ae62547029a75aa38767f4414. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.365262 20788 tablet_service.cc:1467] Processing CreateTablet for tablet 743d96d61f80409e9d57a2f42370c07a (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20250109 21:09:35.384286 20788 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743d96d61f80409e9d57a2f42370c07a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.367677 20719 tablet_service.cc:1467] Processing CreateTablet for tablet becedfcc2b4f4564857442a1cb7fcfbf (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20250109 21:09:35.388312 20719 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becedfcc2b4f4564857442a1cb7fcfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.370077 20720 tablet_service.cc:1467] Processing CreateTablet for tablet 2b14f572654f4e7d92a34209e01df632 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20250109 21:09:35.392650 20720 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14f572654f4e7d92a34209e01df632. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.362370 20715 tablet_service.cc:1467] Processing CreateTablet for tablet 108b9ff6a92049a1824c85dc4a2635f5 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20250109 21:09:35.396623 20715 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108b9ff6a92049a1824c85dc4a2635f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.368892 20712 tablet_service.cc:1467] Processing CreateTablet for tablet d387b5362a59432b99d59665897882d0 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20250109 21:09:35.360108 20717 tablet_service.cc:1467] Processing CreateTablet for tablet 8b39a53ae62547029a75aa38767f4414 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20250109 21:09:35.398895 20712 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d387b5362a59432b99d59665897882d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.399353 20644 tablet_service.cc:1467] Processing CreateTablet for tablet 2b14f572654f4e7d92a34209e01df632 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 214748364 <= VALUES < 429496728
I20250109 21:09:35.400620 20644 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2b14f572654f4e7d92a34209e01df632. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.400736 20717 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b39a53ae62547029a75aa38767f4414. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.365459 20794 tablet_service.cc:1467] Processing CreateTablet for tablet becedfcc2b4f4564857442a1cb7fcfbf (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20250109 21:09:35.402132 20645 tablet_service.cc:1467] Processing CreateTablet for tablet 04dc56331ff84f7e80857e713422faf3 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION VALUES < 214748364
I20250109 21:09:35.402549 20794 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becedfcc2b4f4564857442a1cb7fcfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.403470 20645 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 04dc56331ff84f7e80857e713422faf3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.415841 20643 tablet_service.cc:1467] Processing CreateTablet for tablet becedfcc2b4f4564857442a1cb7fcfbf (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 429496728 <= VALUES < 644245092
I20250109 21:09:35.417153 20643 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet becedfcc2b4f4564857442a1cb7fcfbf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.420171 20642 tablet_service.cc:1467] Processing CreateTablet for tablet 4adc5f2899a14e1c95ee79782aa1eaa5 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 644245092 <= VALUES < 858993456
I20250109 21:09:35.421407 20642 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4adc5f2899a14e1c95ee79782aa1eaa5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.424181 20641 tablet_service.cc:1467] Processing CreateTablet for tablet 8b39a53ae62547029a75aa38767f4414 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 858993456 <= VALUES < 1073741820
I20250109 21:09:35.425408 20641 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b39a53ae62547029a75aa38767f4414. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.428071 20639 tablet_service.cc:1467] Processing CreateTablet for tablet 108b9ff6a92049a1824c85dc4a2635f5 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1288490184 <= VALUES < 1503238548
I20250109 21:09:35.429361 20639 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 108b9ff6a92049a1824c85dc4a2635f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.429224 20637 tablet_service.cc:1467] Processing CreateTablet for tablet 743d96d61f80409e9d57a2f42370c07a (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1717986912 <= VALUES < 1932735276
I20250109 21:09:35.430405 20637 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 743d96d61f80409e9d57a2f42370c07a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.432509 20636 tablet_service.cc:1467] Processing CreateTablet for tablet d387b5362a59432b99d59665897882d0 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1932735276 <= VALUES
I20250109 21:09:35.435238 20640 tablet_service.cc:1467] Processing CreateTablet for tablet 1af768b40f134f1a928ae54f64796392 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1073741820 <= VALUES < 1288490184
I20250109 21:09:35.428066 20638 tablet_service.cc:1467] Processing CreateTablet for tablet d8c47ba51cf3462697faafec02851e47 (DEFAULT_TABLE table=test-workload [id=5824d9b5fd54485cbdd1595b7dd40368]), partition=RANGE (key) PARTITION 1503238548 <= VALUES < 1717986912
I20250109 21:09:35.444039 20847 tablet_bootstrap.cc:492] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.450977 20636 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d387b5362a59432b99d59665897882d0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.474861 20640 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1af768b40f134f1a928ae54f64796392. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.491237 20638 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d8c47ba51cf3462697faafec02851e47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:09:35.504945 20846 tablet_bootstrap.cc:492] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.538764 20848 tablet_bootstrap.cc:492] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:35.537276 20847 tablet_bootstrap.cc:654] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.555336 20846 tablet_bootstrap.cc:654] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.565606 20848 tablet_bootstrap.cc:654] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.569502 20847 tablet_bootstrap.cc:492] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.569994 20846 tablet_bootstrap.cc:492] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.570109 20847 ts_tablet_manager.cc:1397] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.126s user 0.016s sys 0.014s
I20250109 21:09:35.570412 20846 ts_tablet_manager.cc:1397] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.066s user 0.013s sys 0.004s
I20250109 21:09:35.572930 20846 raft_consensus.cc:357] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.573381 20848 tablet_bootstrap.cc:492] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:35.573558 20846 raft_consensus.cc:383] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.573319 20847 raft_consensus.cc:357] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.573961 20846 raft_consensus.cc:738] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.574097 20848 ts_tablet_manager.cc:1397] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.036s user 0.009s sys 0.005s
I20250109 21:09:35.574215 20847 raft_consensus.cc:383] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.574574 20847 raft_consensus.cc:738] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.574679 20846 consensus_queue.cc:260] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.575345 20847 consensus_queue.cc:260] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.576894 20831 heartbeater.cc:502] Master 127.19.136.254:39205 was elected leader, sending a full tablet report...
I20250109 21:09:35.577430 20846 ts_tablet_manager.cc:1428] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:09:35.577016 20848 raft_consensus.cc:357] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:35.578259 20846 tablet_bootstrap.cc:492] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.578181 20848 raft_consensus.cc:383] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.578729 20848 raft_consensus.cc:738] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.579589 20848 consensus_queue.cc:260] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:35.584688 20846 tablet_bootstrap.cc:654] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.585105 20847 ts_tablet_manager.cc:1428] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
I20250109 21:09:35.586019 20757 heartbeater.cc:502] Master 127.19.136.254:39205 was elected leader, sending a full tablet report...
I20250109 21:09:35.596729 20847 tablet_bootstrap.cc:492] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.605219 20847 tablet_bootstrap.cc:654] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.605417 20848 ts_tablet_manager.cc:1428] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.031s user 0.011s sys 0.020s
I20250109 21:09:35.606402 20848 tablet_bootstrap.cc:492] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:35.606637 20681 heartbeater.cc:502] Master 127.19.136.254:39205 was elected leader, sending a full tablet report...
I20250109 21:09:35.610778 20846 tablet_bootstrap.cc:492] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.611224 20846 ts_tablet_manager.cc:1397] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.033s user 0.021s sys 0.010s
I20250109 21:09:35.611768 20847 tablet_bootstrap.cc:492] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.612182 20847 ts_tablet_manager.cc:1397] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.000s
I20250109 21:09:35.612488 20848 tablet_bootstrap.cc:654] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.613746 20846 raft_consensus.cc:357] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.614478 20846 raft_consensus.cc:383] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.614791 20846 raft_consensus.cc:738] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.614825 20847 raft_consensus.cc:357] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.615942 20847 raft_consensus.cc:383] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.615669 20846 consensus_queue.cc:260] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.616326 20847 raft_consensus.cc:738] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.617372 20847 consensus_queue.cc:260] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.619072 20846 ts_tablet_manager.cc:1428] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20250109 21:09:35.619979 20846 tablet_bootstrap.cc:492] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.620617 20847 ts_tablet_manager.cc:1428] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20250109 21:09:35.621706 20847 tablet_bootstrap.cc:492] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.626094 20846 tablet_bootstrap.cc:654] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.629406 20848 tablet_bootstrap.cc:492] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:35.629856 20848 ts_tablet_manager.cc:1397] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.024s user 0.019s sys 0.003s
I20250109 21:09:35.630024 20847 tablet_bootstrap.cc:654] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.632742 20848 raft_consensus.cc:357] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.633513 20848 raft_consensus.cc:383] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.633843 20848 raft_consensus.cc:738] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.634610 20848 consensus_queue.cc:260] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.637518 20848 ts_tablet_manager.cc:1428] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20250109 21:09:35.638444 20848 tablet_bootstrap.cc:492] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:35.639562 20853 raft_consensus.cc:491] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:35.640026 20853 raft_consensus.cc:513] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.640523 20846 tablet_bootstrap.cc:492] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.641146 20846 ts_tablet_manager.cc:1397] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.005s
I20250109 21:09:35.642573 20853 leader_election.cc:290] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:35.643956 20846 raft_consensus.cc:357] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.644773 20846 raft_consensus.cc:383] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.645112 20846 raft_consensus.cc:738] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.645933 20846 consensus_queue.cc:260] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.648240 20846 ts_tablet_manager.cc:1428] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:09:35.649195 20846 tablet_bootstrap.cc:492] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.655485 20846 tablet_bootstrap.cc:654] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.658179 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
W20250109 21:09:35.660444 20694 leader_election.cc:343] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:35.668839 20846 tablet_bootstrap.cc:492] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.669482 20846 ts_tablet_manager.cc:1397] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.020s user 0.018s sys 0.000s
I20250109 21:09:35.672523 20846 raft_consensus.cc:357] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.673398 20846 raft_consensus.cc:383] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.673743 20846 raft_consensus.cc:738] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.674402 20846 consensus_queue.cc:260] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.674948 20847 tablet_bootstrap.cc:492] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.675455 20848 tablet_bootstrap.cc:654] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.676522 20847 ts_tablet_manager.cc:1397] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.055s user 0.023s sys 0.019s
I20250109 21:09:35.677971 20846 ts_tablet_manager.cc:1428] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250109 21:09:35.678884 20846 tablet_bootstrap.cc:492] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.679710 20847 raft_consensus.cc:357] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.680661 20847 raft_consensus.cc:383] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.681041 20847 raft_consensus.cc:738] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.681864 20847 consensus_queue.cc:260] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.684811 20847 ts_tablet_manager.cc:1428] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250109 21:09:35.685249 20846 tablet_bootstrap.cc:654] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.685935 20847 tablet_bootstrap.cc:492] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.694090 20847 tablet_bootstrap.cc:654] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.696339 20846 tablet_bootstrap.cc:492] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.696821 20846 ts_tablet_manager.cc:1397] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.007s
I20250109 21:09:35.699787 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:35.699638 20846 raft_consensus.cc:357] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.700381 20846 raft_consensus.cc:383] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.700431 20806 raft_consensus.cc:2463] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 0.
I20250109 21:09:35.700763 20846 raft_consensus.cc:738] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.701617 20846 consensus_queue.cc:260] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.705554 20846 ts_tablet_manager.cc:1428] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.008s user 0.004s sys 0.003s
I20250109 21:09:35.706382 20846 tablet_bootstrap.cc:492] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.707989 20697 leader_election.cc:304] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters: 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:35.708819 20853 raft_consensus.cc:2798] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:35.709182 20853 raft_consensus.cc:491] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:35.709534 20853 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:35.712420 20846 tablet_bootstrap.cc:654] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.717967 20847 tablet_bootstrap.cc:492] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.718536 20847 ts_tablet_manager.cc:1397] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.033s user 0.011s sys 0.019s
I20250109 21:09:35.721218 20853 raft_consensus.cc:513] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.721841 20847 raft_consensus.cc:357] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.722800 20847 raft_consensus.cc:383] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.723191 20847 raft_consensus.cc:738] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.724151 20847 consensus_queue.cc:260] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.726244 20853 leader_election.cc:290] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:35.726662 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
W20250109 21:09:35.728338 20694 leader_election.cc:343] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:35.728199 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:35.729228 20806 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:35.735980 20852 raft_consensus.cc:491] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:35.736411 20852 raft_consensus.cc:513] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.738204 20806 raft_consensus.cc:2463] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 1.
I20250109 21:09:35.738824 20852 leader_election.cc:290] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:35.742027 20848 tablet_bootstrap.cc:492] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:35.742527 20848 ts_tablet_manager.cc:1397] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.104s user 0.037s sys 0.022s
I20250109 21:09:35.744407 20847 ts_tablet_manager.cc:1428] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.026s user 0.011s sys 0.002s
I20250109 21:09:35.745250 20848 raft_consensus.cc:357] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.745786 20846 tablet_bootstrap.cc:492] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.746616 20846 ts_tablet_manager.cc:1397] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.040s user 0.023s sys 0.008s
I20250109 21:09:35.749243 20847 tablet_bootstrap.cc:492] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.745973 20848 raft_consensus.cc:383] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.749991 20848 raft_consensus.cc:738] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.750414 20846 raft_consensus.cc:357] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.751224 20846 raft_consensus.cc:383] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.751574 20846 raft_consensus.cc:738] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.752331 20846 consensus_queue.cc:260] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.750772 20848 consensus_queue.cc:260] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.755044 20846 ts_tablet_manager.cc:1428] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250109 21:09:35.755488 20847 tablet_bootstrap.cc:654] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.756083 20846 tablet_bootstrap.cc:492] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.760284 20848 ts_tablet_manager.cc:1428] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.017s user 0.008s sys 0.000s
I20250109 21:09:35.761402 20848 tablet_bootstrap.cc:492] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:35.762634 20846 tablet_bootstrap.cc:654] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.777911 20852 raft_consensus.cc:491] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:35.778513 20852 raft_consensus.cc:513] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.782334 20848 tablet_bootstrap.cc:654] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.784116 20852 leader_election.cc:290] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:35.789886 20697 leader_election.cc:304] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters: 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:35.791007 20866 raft_consensus.cc:2798] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:35.791533 20866 raft_consensus.cc:695] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:35.792565 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:35.792858 20846 tablet_bootstrap.cc:492] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.792376 20866 consensus_queue.cc:237] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.793258 20731 raft_consensus.cc:2463] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:35.793534 20846 ts_tablet_manager.cc:1397] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.038s user 0.013s sys 0.023s
I20250109 21:09:35.795466 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:35.796406 20846 raft_consensus.cc:357] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:35.797194 20846 raft_consensus.cc:383] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.797281 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:35.797581 20846 raft_consensus.cc:738] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.798460 20847 tablet_bootstrap.cc:492] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.798472 20846 consensus_queue.cc:260] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:35.799217 20847 ts_tablet_manager.cc:1397] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.032s
I20250109 21:09:35.799275 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:35.801280 20846 ts_tablet_manager.cc:1428] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:09:35.802038 20848 tablet_bootstrap.cc:492] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:35.802481 20846 tablet_bootstrap.cc:492] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.802592 20848 ts_tablet_manager.cc:1397] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.011s
I20250109 21:09:35.806088 20848 raft_consensus.cc:357] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.807009 20848 raft_consensus.cc:383] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.807387 20848 raft_consensus.cc:738] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.802089 20847 raft_consensus.cc:357] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.808632 20847 raft_consensus.cc:383] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.808403 20848 consensus_queue.cc:260] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.808933 20847 raft_consensus.cc:738] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.809396 20846 tablet_bootstrap.cc:654] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.811576 20848 ts_tablet_manager.cc:1428] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250109 21:09:35.812522 20848 tablet_bootstrap.cc:492] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:35.815044 20847 consensus_queue.cc:260] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.817739 20847 ts_tablet_manager.cc:1428] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20250109 21:09:35.818565 20848 tablet_bootstrap.cc:654] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.818686 20847 tablet_bootstrap.cc:492] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.818235 20549 catalog_manager.cc:5526] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:35.823679 20769 leader_election.cc:304] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:35.824487 20852 raft_consensus.cc:2798] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:35.824828 20852 raft_consensus.cc:491] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:35.825131 20852 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:35.825345 20847 tablet_bootstrap.cc:654] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.833482 20852 raft_consensus.cc:513] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
W20250109 21:09:35.834694 20769 leader_election.cc:343] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:35.835484 20852 leader_election.cc:290] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
W20250109 21:09:35.835600 20769 leader_election.cc:343] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:35.836285 20847 tablet_bootstrap.cc:492] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.836601 20847 ts_tablet_manager.cc:1397] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.008s
W20250109 21:09:35.837023 20769 leader_election.cc:343] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:35.838853 20847 raft_consensus.cc:357] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.839661 20847 raft_consensus.cc:383] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.839998 20847 raft_consensus.cc:738] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.839740 20769 leader_election.cc:304] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e07d8a6ea0f7452a82aa3decda98d38c; no voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6
I20250109 21:09:35.840821 20847 consensus_queue.cc:260] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.843775 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:35.844101 20847 ts_tablet_manager.cc:1428] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20250109 21:09:35.845168 20847 tablet_bootstrap.cc:492] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
W20250109 21:09:35.846398 20769 leader_election.cc:343] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:35.847007 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:35.847779 20852 raft_consensus.cc:2743] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:35.848148 20731 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:35.853040 20847 tablet_bootstrap.cc:654] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.854151 20848 tablet_bootstrap.cc:492] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:35.854686 20848 ts_tablet_manager.cc:1397] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.042s user 0.009s sys 0.008s
I20250109 21:09:35.855382 20731 raft_consensus.cc:2463] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 1.
I20250109 21:09:35.856449 20769 leader_election.cc:304] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters: 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:35.857484 20852 raft_consensus.cc:2798] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:35.858129 20848 raft_consensus.cc:357] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.858588 20846 tablet_bootstrap.cc:492] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.858976 20848 raft_consensus.cc:383] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.859180 20846 ts_tablet_manager.cc:1397] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.057s user 0.009s sys 0.028s
I20250109 21:09:35.859328 20848 raft_consensus.cc:738] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.860191 20848 consensus_queue.cc:260] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.861550 20846 raft_consensus.cc:357] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.862181 20846 raft_consensus.cc:383] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.862459 20846 raft_consensus.cc:738] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.863158 20846 consensus_queue.cc:260] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.870294 20846 ts_tablet_manager.cc:1428] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.011s user 0.005s sys 0.002s
I20250109 21:09:35.871212 20846 tablet_bootstrap.cc:492] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.871821 20848 ts_tablet_manager.cc:1428] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.017s user 0.001s sys 0.005s
I20250109 21:09:35.876297 20846 tablet_bootstrap.cc:654] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.877707 20847 tablet_bootstrap.cc:492] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.878264 20847 ts_tablet_manager.cc:1397] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.033s user 0.014s sys 0.008s
W20250109 21:09:35.878683 20600 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:09:35.879201 20852 raft_consensus.cc:695] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:35.880061 20852 consensus_queue.cc:237] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.881068 20848 tablet_bootstrap.cc:492] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:35.881404 20847 raft_consensus.cc:357] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.882155 20847 raft_consensus.cc:383] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.882437 20847 raft_consensus.cc:738] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.883352 20847 consensus_queue.cc:260] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.885504 20846 tablet_bootstrap.cc:492] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.885802 20847 ts_tablet_manager.cc:1428] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20250109 21:09:35.885931 20846 ts_tablet_manager.cc:1397] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.015s user 0.012s sys 0.000s
I20250109 21:09:35.886672 20847 tablet_bootstrap.cc:492] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.888458 20848 tablet_bootstrap.cc:654] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.888211 20846 raft_consensus.cc:357] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.890473 20846 raft_consensus.cc:383] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.890766 20846 raft_consensus.cc:738] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.892483 20846 consensus_queue.cc:260] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.893241 20847 tablet_bootstrap.cc:654] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.901473 20846 ts_tablet_manager.cc:1428] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20250109 21:09:35.902415 20846 tablet_bootstrap.cc:492] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c: Bootstrap starting.
I20250109 21:09:35.904047 20847 tablet_bootstrap.cc:492] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.904492 20847 ts_tablet_manager.cc:1397] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20250109 21:09:35.905717 20848 tablet_bootstrap.cc:492] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:35.906159 20848 ts_tablet_manager.cc:1397] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.013s
I20250109 21:09:35.907325 20846 tablet_bootstrap.cc:654] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.907073 20552 catalog_manager.cc:5526] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 0 to 1, leader changed from <none> to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:35.908389 20848 raft_consensus.cc:357] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.908962 20848 raft_consensus.cc:383] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.909173 20848 raft_consensus.cc:738] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.909494 20866 raft_consensus.cc:491] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:35.909889 20866 raft_consensus.cc:513] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.907058 20847 raft_consensus.cc:357] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.911170 20847 raft_consensus.cc:383] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.911494 20847 raft_consensus.cc:738] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.911844 20866 leader_election.cc:290] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:35.909865 20848 consensus_queue.cc:260] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.912376 20847 consensus_queue.cc:260] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.915374 20847 ts_tablet_manager.cc:1428] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20250109 21:09:35.915688 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "becedfcc2b4f4564857442a1cb7fcfbf" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:35.916370 20847 tablet_bootstrap.cc:492] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.916954 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "becedfcc2b4f4564857442a1cb7fcfbf" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:35.920531 20848 ts_tablet_manager.cc:1428] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.014s user 0.001s sys 0.005s
I20250109 21:09:35.923434 20847 tablet_bootstrap.cc:654] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
W20250109 21:09:35.923627 20697 leader_election.cc:343] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:09:35.916285 20656 raft_consensus.cc:2463] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 0.
I20250109 21:09:35.925593 20694 leader_election.cc:304] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters: e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:35.926676 20866 raft_consensus.cc:2798] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:35.927038 20866 raft_consensus.cc:491] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:35.927381 20866 raft_consensus.cc:3054] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:35.930166 20848 tablet_bootstrap.cc:492] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:35.926671 20852 raft_consensus.cc:491] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:35.931318 20852 raft_consensus.cc:513] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.933053 20852 leader_election.cc:290] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:35.935531 20847 tablet_bootstrap.cc:492] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:35.936017 20847 ts_tablet_manager.cc:1397] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.020s user 0.012s sys 0.005s
I20250109 21:09:35.935870 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b14f572654f4e7d92a34209e01df632" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:35.936581 20731 raft_consensus.cc:2463] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:35.936661 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b14f572654f4e7d92a34209e01df632" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:35.937328 20656 raft_consensus.cc:2463] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:35.938017 20769 leader_election.cc:304] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:35.939515 20852 raft_consensus.cc:2798] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:35.939823 20852 raft_consensus.cc:491] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:35.940135 20852 raft_consensus.cc:3054] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:35.940784 20848 tablet_bootstrap.cc:654] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.946092 20847 raft_consensus.cc:357] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:35.946970 20847 raft_consensus.cc:383] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.947309 20847 raft_consensus.cc:738] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.948287 20847 consensus_queue.cc:260] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:35.950165 20847 ts_tablet_manager.cc:1428] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20250109 21:09:35.950501 20846 tablet_bootstrap.cc:492] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c: No bootstrap required, opened a new log
I20250109 21:09:35.951005 20847 tablet_bootstrap.cc:492] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Bootstrap starting.
I20250109 21:09:35.950971 20866 raft_consensus.cc:513] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.953608 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "becedfcc2b4f4564857442a1cb7fcfbf" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:35.954169 20656 raft_consensus.cc:3054] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:35.955884 20848 tablet_bootstrap.cc:492] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:35.956350 20848 ts_tablet_manager.cc:1397] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.005s
I20250109 21:09:35.956919 20847 tablet_bootstrap.cc:654] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.951006 20846 ts_tablet_manager.cc:1397] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c: Time spent bootstrapping tablet: real 0.049s user 0.025s sys 0.023s
I20250109 21:09:35.959132 20848 raft_consensus.cc:357] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.960098 20848 raft_consensus.cc:383] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.960422 20848 raft_consensus.cc:738] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.960747 20656 raft_consensus.cc:2463] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 1.
I20250109 21:09:35.961143 20848 consensus_queue.cc:260] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.961405 20846 raft_consensus.cc:357] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.961755 20694 leader_election.cc:304] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:35.962049 20846 raft_consensus.cc:383] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:35.962368 20846 raft_consensus.cc:738] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Initialized, Role: FOLLOWER
I20250109 21:09:35.963164 20853 raft_consensus.cc:2798] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:35.963088 20846 consensus_queue.cc:260] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.964041 20848 ts_tablet_manager.cc:1428] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:09:35.964946 20848 tablet_bootstrap.cc:492] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:35.965305 20846 ts_tablet_manager.cc:1428] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:09:35.977720 20854 raft_consensus.cc:491] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:35.978189 20854 raft_consensus.cc:513] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.980827 20854 leader_election.cc:290] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:35.987969 20852 raft_consensus.cc:513] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.990170 20880 raft_consensus.cc:491] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:35.990851 20848 tablet_bootstrap.cc:654] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:35.990753 20880 raft_consensus.cc:513] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:35.993193 20880 leader_election.cc:290] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:35.995987 20891 raft_consensus.cc:491] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:35.995900 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b14f572654f4e7d92a34209e01df632" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:35.996793 20655 raft_consensus.cc:3054] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:35.997031 20654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:35.997885 20654 raft_consensus.cc:2463] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:35.999512 20769 leader_election.cc:304] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.000538 20880 raft_consensus.cc:2798] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:36.001014 20880 raft_consensus.cc:491] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:36.001405 20880 raft_consensus.cc:3054] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.006341 20847 tablet_bootstrap.cc:492] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: No bootstrap required, opened a new log
I20250109 21:09:36.006655 20655 raft_consensus.cc:2463] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 1.
I20250109 21:09:36.007789 20891 raft_consensus.cc:513] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.008150 20769 leader_election.cc:304] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.009318 20881 raft_consensus.cc:2798] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:36.006788 20847 ts_tablet_manager.cc:1397] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent bootstrapping tablet: real 0.056s user 0.010s sys 0.002s
I20250109 21:09:36.010416 20891 leader_election.cc:290] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.013413 20847 raft_consensus.cc:357] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.012789 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:36.051800 20853 raft_consensus.cc:695] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.033774 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "becedfcc2b4f4564857442a1cb7fcfbf" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.052428 20805 raft_consensus.cc:3054] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.053452 20848 tablet_bootstrap.cc:492] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:36.052848 20853 consensus_queue.cc:237] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.054003 20848 ts_tablet_manager.cc:1397] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.089s user 0.034s sys 0.032s
I20250109 21:09:36.056433 20848 raft_consensus.cc:357] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.057128 20848 raft_consensus.cc:383] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:36.057449 20848 raft_consensus.cc:738] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:36.057750 20852 leader_election.cc:290] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:36.049413 20890 raft_consensus.cc:491] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:36.058079 20848 consensus_queue.cc:260] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.058851 20730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b14f572654f4e7d92a34209e01df632" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.058807 20890 raft_consensus.cc:513] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.049898 20891 raft_consensus.cc:491] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:36.060014 20891 raft_consensus.cc:513] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.031920 20866 leader_election.cc:290] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.051316 20881 raft_consensus.cc:695] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:36.059567 20730 raft_consensus.cc:3054] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.012185 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d387b5362a59432b99d59665897882d0" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:36.062644 20848 ts_tablet_manager.cc:1428] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20250109 21:09:36.062724 20806 raft_consensus.cc:2463] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 0.
I20250109 21:09:36.063710 20848 tablet_bootstrap.cc:492] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:36.063809 20697 leader_election.cc:304] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.064611 20731 raft_consensus.cc:2463] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:36.065632 20804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:36.066063 20891 leader_election.cc:290] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.051883 20847 raft_consensus.cc:383] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:36.066883 20847 raft_consensus.cc:738] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Initialized, Role: FOLLOWER
I20250109 21:09:36.067561 20847 consensus_queue.cc:260] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.067797 20805 raft_consensus.cc:2463] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 1.
I20250109 21:09:36.068224 20730 raft_consensus.cc:2463] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 1.
I20250109 21:09:36.069873 20847 ts_tablet_manager.cc:1428] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: Time spent starting tablet: real 0.059s user 0.005s sys 0.017s
I20250109 21:09:36.070350 20881 consensus_queue.cc:237] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.072751 20848 tablet_bootstrap.cc:654] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:36.074519 20866 raft_consensus.cc:2798] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:36.075031 20866 raft_consensus.cc:491] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:36.075459 20866 raft_consensus.cc:3054] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.077347 20848 tablet_bootstrap.cc:492] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:36.077693 20848 ts_tablet_manager.cc:1397] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.014s user 0.009s sys 0.000s
I20250109 21:09:36.079576 20848 raft_consensus.cc:357] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.080225 20848 raft_consensus.cc:383] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:36.080511 20848 raft_consensus.cc:738] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:36.081055 20848 consensus_queue.cc:260] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.081169 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d387b5362a59432b99d59665897882d0" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:36.081777 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:36.081959 20656 raft_consensus.cc:2463] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 0.
I20250109 21:09:36.082382 20655 raft_consensus.cc:2463] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 0.
I20250109 21:09:36.083979 20694 leader_election.cc:304] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.084975 20889 raft_consensus.cc:2798] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:36.085417 20889 raft_consensus.cc:491] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:36.085852 20889 raft_consensus.cc:3054] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.087146 20866 raft_consensus.cc:513] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.089982 20848 ts_tablet_manager.cc:1428] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20250109 21:09:36.038496 20880 raft_consensus.cc:513] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.092733 20804 raft_consensus.cc:2388] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in current term 1: Already voted for candidate e07d8a6ea0f7452a82aa3decda98d38c in this term.
I20250109 21:09:36.092881 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "743d96d61f80409e9d57a2f42370c07a" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:36.093529 20806 raft_consensus.cc:2463] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 0.
I20250109 21:09:36.094864 20697 leader_election.cc:304] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.096952 20891 raft_consensus.cc:2798] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:36.097409 20891 raft_consensus.cc:491] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:36.097828 20891 raft_consensus.cc:3054] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.094408 20880 leader_election.cc:290] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:36.099583 20848 tablet_bootstrap.cc:492] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1: Bootstrap starting.
I20250109 21:09:36.099874 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.100528 20656 raft_consensus.cc:3054] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.103248 20730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.105602 20848 tablet_bootstrap.cc:654] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1: Neither blocks nor log segments found. Creating new log.
I20250109 21:09:36.090863 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d387b5362a59432b99d59665897882d0" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.091174 20854 raft_consensus.cc:491] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:36.091836 20890 leader_election.cc:290] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.095125 20881 raft_consensus.cc:491] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:36.108295 20854 raft_consensus.cc:513] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.108572 20881 raft_consensus.cc:513] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:36.107352 20805 raft_consensus.cc:3054] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.110680 20854 leader_election.cc:290] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.111276 20854 raft_consensus.cc:491] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:36.111784 20854 raft_consensus.cc:513] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:36.113790 20854 leader_election.cc:290] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.114279 20854 raft_consensus.cc:491] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:36.114171 20891 raft_consensus.cc:513] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.115590 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:36.116031 20891 leader_election.cc:290] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.116168 20731 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:36.117573 20881 leader_election.cc:290] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345)
I20250109 21:09:36.117920 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "743d96d61f80409e9d57a2f42370c07a" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.118456 20806 raft_consensus.cc:3054] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.118774 20550 catalog_manager.cc:5526] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 0 to 1, leader changed from <none> to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:36.117576 20769 leader_election.cc:304] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.091653 20866 leader_election.cc:290] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.122709 20654 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d387b5362a59432b99d59665897882d0" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.123524 20654 raft_consensus.cc:3054] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.119513 20805 raft_consensus.cc:2463] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 1.
I20250109 21:09:36.122066 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:36.122581 20881 raft_consensus.cc:2798] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:36.122611 20656 raft_consensus.cc:2463] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 1.
I20250109 21:09:36.126454 20655 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:36.127313 20653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "743d96d61f80409e9d57a2f42370c07a" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:36.128098 20653 raft_consensus.cc:2463] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 0.
I20250109 21:09:36.107920 20889 raft_consensus.cc:513] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.125487 20881 raft_consensus.cc:491] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:36.131732 20881 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.134482 20848 tablet_bootstrap.cc:492] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1: No bootstrap required, opened a new log
I20250109 21:09:36.135071 20848 ts_tablet_manager.cc:1397] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent bootstrapping tablet: real 0.036s user 0.006s sys 0.007s
I20250109 21:09:36.138454 20848 raft_consensus.cc:357] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.139355 20848 raft_consensus.cc:383] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:09:36.139801 20848 raft_consensus.cc:738] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Initialized, Role: FOLLOWER
I20250109 21:09:36.114806 20854 raft_consensus.cc:513] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.140478 20848 consensus_queue.cc:260] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.147614 20881 raft_consensus.cc:513] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:36.149932 20881 leader_election.cc:290] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345)
I20250109 21:09:36.151891 20730 raft_consensus.cc:2388] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e07d8a6ea0f7452a82aa3decda98d38c in current term 1: Already voted for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in this term.
I20250109 21:09:36.141194 20769 leader_election.cc:304] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.206730 20802 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:36.216895 20880 raft_consensus.cc:491] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:36.169991 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:36.152843 20803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:36.217887 20731 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 0.
I20250109 21:09:36.218099 20802 raft_consensus.cc:2388] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 670b1b7fdd4640d68f75d69832d02eb1 in current term 1: Already voted for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in this term.
I20250109 21:09:36.217763 20880 raft_consensus.cc:513] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.206856 20654 raft_consensus.cc:2463] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 1.
I20250109 21:09:36.165305 20848 ts_tablet_manager.cc:1428] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1: Time spent starting tablet: real 0.030s user 0.006s sys 0.001s
W20250109 21:09:36.217482 20769 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:37345, user_credentials={real_user=slave}} blocked reactor thread for 86204.3us
I20250109 21:09:36.152778 20854 leader_election.cc:290] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.198504 20730 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:36.231871 20697 leader_election.cc:304] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.232352 20730 raft_consensus.cc:2388] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 670b1b7fdd4640d68f75d69832d02eb1 in current term 1: Already voted for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in this term.
I20250109 21:09:36.232647 20866 raft_consensus.cc:2798] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:36.152326 20804 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:36.233141 20866 raft_consensus.cc:695] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.233532 20804 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 0.
I20250109 21:09:36.218389 20803 raft_consensus.cc:2388] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 670b1b7fdd4640d68f75d69832d02eb1 in current term 1: Already voted for candidate e07d8a6ea0f7452a82aa3decda98d38c in this term.
I20250109 21:09:36.197163 20806 raft_consensus.cc:2463] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 1.
I20250109 21:09:36.233990 20866 consensus_queue.cc:237] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.234768 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.234958 20727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:36.200291 20889 leader_election.cc:290] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.219959 20880 leader_election.cc:290] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:36.236187 20880 raft_consensus.cc:2798] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:36.235940 20652 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:36.236511 20880 raft_consensus.cc:695] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:36.236626 20652 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:36.237289 20880 consensus_queue.cc:237] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.206406 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:36.157997 20653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "743d96d61f80409e9d57a2f42370c07a" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.240130 20653 raft_consensus.cc:3054] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.235357 20656 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.219036 20617 leader_election.cc:304] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.242707 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.191866 20728 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:36.170552 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:36.157888 20853 raft_consensus.cc:491] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:09:36.193297 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.245959 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.246757 20655 raft_consensus.cc:2388] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in current term 1: Already voted for candidate e07d8a6ea0f7452a82aa3decda98d38c in this term.
I20250109 21:09:36.245090 20731 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.246137 20853 raft_consensus.cc:513] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.176045 20551 catalog_manager.cc:5526] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.252076 20727 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 0.
I20250109 21:09:36.252645 20653 raft_consensus.cc:2463] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 1.
I20250109 21:09:36.253523 20854 raft_consensus.cc:2798] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:36.253887 20854 raft_consensus.cc:491] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:36.254225 20694 leader_election.cc:304] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.254264 20854 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.255159 20891 raft_consensus.cc:2798] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:36.255295 20769 leader_election.cc:304] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.255715 20891 raft_consensus.cc:695] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.256793 20881 raft_consensus.cc:2798] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:36.256500 20891 consensus_queue.cc:237] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.257712 20697 leader_election.cc:304] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:36.258797 20889 raft_consensus.cc:2743] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:09:36.259070 20653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:36.259661 20653 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 0.
I20250109 21:09:36.266556 20656 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 1.
I20250109 21:09:36.269359 20769 leader_election.cc:304] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.270364 20852 raft_consensus.cc:2798] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:36.270890 20852 raft_consensus.cc:695] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:36.271901 20854 raft_consensus.cc:513] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.272253 20852 consensus_queue.cc:237] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:36.254011 20617 leader_election.cc:304] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1; no voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:36.279363 20900 raft_consensus.cc:2743] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:36.283434 20694 leader_election.cc:304] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.284500 20656 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.284638 20889 raft_consensus.cc:2798] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:09:36.285005 20889 raft_consensus.cc:491] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:36.257143 20881 raft_consensus.cc:491] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:09:36.285332 20889 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.288226 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.288973 20805 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.271217 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" is_pre_election: true
I20250109 21:09:36.257122 20853 leader_election.cc:290] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.286649 20881 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.303498 20896 consensus_queue.cc:1035] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250109 21:09:36.295939 20731 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 1.
I20250109 21:09:36.312264 20880 consensus_queue.cc:1035] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.313107 20551 catalog_manager.cc:5526] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.297645 20617 leader_election.cc:304] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1; no voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:36.316134 20617 leader_election.cc:304] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1; no voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:36.316053 20881 raft_consensus.cc:513] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.287099 20854 leader_election.cc:290] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.318167 20900 raft_consensus.cc:2743] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:36.323309 20901 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.319447 20889 raft_consensus.cc:513] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.320626 20806 raft_consensus.cc:2388] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in current term 1: Already voted for candidate e07d8a6ea0f7452a82aa3decda98d38c in this term.
I20250109 21:09:36.326705 20889 leader_election.cc:290] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.327462 20653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.327819 20803 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.328038 20653 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.318841 20551 catalog_manager.cc:5526] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.330797 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.331382 20731 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:09:36.332990 20805 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 1.
I20250109 21:09:36.333333 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.335121 20621 leader_election.cc:304] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.335988 20900 raft_consensus.cc:2798] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:36.336462 20900 raft_consensus.cc:695] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:36.337265 20900 consensus_queue.cc:237] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.337699 20550 catalog_manager.cc:5526] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 0 to 1, leader changed from <none> to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:36.338524 20653 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 1.
I20250109 21:09:36.339604 20694 leader_election.cc:304] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters: e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:36.340874 20889 raft_consensus.cc:2798] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:09:36.341481 20889 raft_consensus.cc:695] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.342054 20901 raft_consensus.cc:2743] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:09:36.342275 20889 consensus_queue.cc:237] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.347038 20727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.350253 20769 leader_election.cc:304] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e07d8a6ea0f7452a82aa3decda98d38c; no voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6
I20250109 21:09:36.351437 20852 raft_consensus.cc:2743] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:09:36.356117 20853 consensus_queue.cc:1035] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:09:36.348529 20881 leader_election.cc:290] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 1 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:36.381775 20731 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 1.
I20250109 21:09:36.390173 20550 catalog_manager.cc:5526] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 0 to 1, leader changed from <none> to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.392935 20866 consensus_queue.cc:1035] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.392186 20551 catalog_manager.cc:5526] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 0 to 1, leader changed from <none> to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.408783 20552 catalog_manager.cc:5526] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 0 to 1, leader changed from <none> to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.441814 20866 consensus_queue.cc:1035] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.450696 20866 consensus_queue.cc:1035] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.475317 20852 consensus_queue.cc:1035] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.483774 20852 consensus_queue.cc:1035] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.508253 20806 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:45338
I20250109 21:09:36.508746 20806 raft_consensus.cc:604] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:36.512593 20806 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2b14f572654f4e7d92a34209e01df632"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:45338
I20250109 21:09:36.512969 20806 raft_consensus.cc:604] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:36.523109 20729 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "becedfcc2b4f4564857442a1cb7fcfbf"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:48110
I20250109 21:09:36.523540 20729 raft_consensus.cc:604] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:36.527345 20806 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:45338
I20250109 21:09:36.527767 20806 raft_consensus.cc:604] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:36.531777 20729 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:48110
I20250109 21:09:36.532333 20729 raft_consensus.cc:604] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:36.546454 20653 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
mode: GRACEFUL
new_leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
from {username='slave'} at 127.0.0.1:47264
I20250109 21:09:36.546880 20653 raft_consensus.cc:604] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 LEADER]: Received request to transfer leadership to TS 7d1cfc96f0d040b6b8c7e5971c1819e6
I20250109 21:09:36.551019 20806 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
mode: GRACEFUL
new_leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
from {username='slave'} at 127.0.0.1:45338
I20250109 21:09:36.551455 20806 raft_consensus.cc:604] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Received request to transfer leadership to TS 7d1cfc96f0d040b6b8c7e5971c1819e6
I20250109 21:09:36.557803 20729 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d387b5362a59432b99d59665897882d0"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
mode: GRACEFUL
new_leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:48110
I20250109 21:09:36.558265 20729 raft_consensus.cc:604] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Received request to transfer leadership to TS e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:36.653431 20852 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.659022 20880 raft_consensus.cc:988] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:36.659483 20881 raft_consensus.cc:1076] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:36.661645 20656 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47258
I20250109 21:09:36.662225 20656 raft_consensus.cc:491] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:36.662595 20656 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.664268 20852 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.669071 20852 consensus_queue.cc:1035] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.669737 20880 consensus_queue.cc:1035] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.671283 20656 raft_consensus.cc:513] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:36.674703 20656 leader_election.cc:290] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.675354 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.676100 20731 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.677901 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.678611 20806 raft_consensus.cc:3049] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:36.679039 20806 raft_consensus.cc:738] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:36.679977 20806 consensus_queue.cc:260] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:36.682298 20806 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:09:36.684671 20852 consensus_queue.cc:1159] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" responder_term: 1 status { last_received { term: 1 index: 1 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 1 } }
I20250109 21:09:36.686720 20731 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:36.687803 20617 leader_election.cc:304] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.688542 20806 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:36.688606 20900 raft_consensus.cc:2798] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:36.689165 20900 raft_consensus.cc:695] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:36.689960 20900 consensus_queue.cc:237] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:36.696774 20852 raft_consensus.cc:988] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:36.697220 20852 raft_consensus.cc:1076] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:36.699368 20653 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47258
I20250109 21:09:36.699954 20653 raft_consensus.cc:491] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:36.699430 20552 catalog_manager.cc:5526] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 1 to 2, leader changed from e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:36.700294 20653 raft_consensus.cc:3054] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.708904 20653 raft_consensus.cc:513] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.710740 20653 leader_election.cc:290] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.711306 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.711787 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.711860 20729 raft_consensus.cc:3054] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.712277 20806 raft_consensus.cc:3049] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:36.712553 20806 raft_consensus.cc:738] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:36.713153 20806 consensus_queue.cc:260] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.714072 20806 raft_consensus.cc:3054] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.718009 20729 raft_consensus.cc:2463] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:36.719025 20617 leader_election.cc:304] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.719120 20866 consensus_queue.cc:1035] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.719673 20900 raft_consensus.cc:2798] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:36.719748 20806 raft_consensus.cc:2463] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:36.720134 20900 raft_consensus.cc:695] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:36.721182 20900 consensus_queue.cc:237] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.726608 20866 raft_consensus.cc:988] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6: : Instructing follower e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:36.727754 20853 raft_consensus.cc:1076] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Signalling peer e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:36.728225 20550 catalog_manager.cc:5526] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 1 to 2, leader changed from e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.729501 20805 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d387b5362a59432b99d59665897882d0"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:45312
I20250109 21:09:36.730032 20805 raft_consensus.cc:491] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:36.730401 20805 raft_consensus.cc:3054] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.735199 20805 raft_consensus.cc:513] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.738430 20853 consensus_queue.cc:1035] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.740193 20805 leader_election.cc:290] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 2 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:36.740717 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d387b5362a59432b99d59665897882d0" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.741736 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d387b5362a59432b99d59665897882d0" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.742460 20729 raft_consensus.cc:3049] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:36.742857 20729 raft_consensus.cc:738] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.745857 20729 consensus_queue.cc:260] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.746829 20900 consensus_queue.cc:1035] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.747079 20729 raft_consensus.cc:3054] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.754046 20901 raft_consensus.cc:988] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1: : Instructing follower 7d1cfc96f0d040b6b8c7e5971c1819e6 to start an election
I20250109 21:09:36.754442 20901 raft_consensus.cc:1076] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 LEADER]: Signalling peer 7d1cfc96f0d040b6b8c7e5971c1819e6 to start an election
I20250109 21:09:36.753628 20729 raft_consensus.cc:2463] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 2.
I20250109 21:09:36.756316 20727 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
from {username='slave'} at 127.0.0.1:48100
I20250109 21:09:36.757050 20769 leader_election.cc:304] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters: 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:36.757952 20881 raft_consensus.cc:2798] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:36.758105 20727 raft_consensus.cc:491] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:36.758433 20881 raft_consensus.cc:695] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:36.758556 20727 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.759254 20854 consensus_queue.cc:1035] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.759279 20881 consensus_queue.cc:237] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.764649 20727 raft_consensus.cc:513] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.768920 20653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.769495 20653 raft_consensus.cc:3049] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:36.769863 20653 raft_consensus.cc:738] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:36.770534 20653 consensus_queue.cc:260] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.770756 20551 catalog_manager.cc:5526] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 1 to 2, leader changed from 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194) to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 2 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:36.771597 20653 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.772238 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.772758 20805 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.777693 20727 leader_election.cc:290] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 2 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.777837 20653 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 2.
I20250109 21:09:36.778800 20694 leader_election.cc:304] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.779656 20853 raft_consensus.cc:2798] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:36.780114 20805 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 2.
I20250109 21:09:36.780170 20853 raft_consensus.cc:695] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.781176 20853 consensus_queue.cc:237] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.785487 20881 raft_consensus.cc:988] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c: : Instructing follower 7d1cfc96f0d040b6b8c7e5971c1819e6 to start an election
I20250109 21:09:36.785950 20881 raft_consensus.cc:1076] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Signalling peer 7d1cfc96f0d040b6b8c7e5971c1819e6 to start an election
I20250109 21:09:36.787473 20727 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
from {username='slave'} at 127.0.0.1:48096
I20250109 21:09:36.787968 20727 raft_consensus.cc:491] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:36.788329 20727 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.789970 20550 catalog_manager.cc:5526] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 1 to 2, leader changed from 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193) to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.794016 20727 raft_consensus.cc:513] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.795572 20727 leader_election.cc:290] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 2 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.796478 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.796200 20653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:36.797039 20805 raft_consensus.cc:3049] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:36.797309 20653 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.797399 20805 raft_consensus.cc:738] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:36.798254 20805 consensus_queue.cc:260] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.799295 20805 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.801870 20653 raft_consensus.cc:2463] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 2.
I20250109 21:09:36.802673 20694 leader_election.cc:304] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.803334 20853 raft_consensus.cc:2798] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:36.803733 20805 raft_consensus.cc:2463] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 2.
I20250109 21:09:36.803906 20853 raft_consensus.cc:695] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.804793 20853 consensus_queue.cc:237] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.810552 20550 catalog_manager.cc:5526] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 1 to 2, leader changed from e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195) to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.820137 20853 consensus_queue.cc:1035] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.829625 20853 consensus_queue.cc:1035] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.838609 20853 raft_consensus.cc:988] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:36.839068 20891 raft_consensus.cc:1076] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:36.840569 20653 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47254
I20250109 21:09:36.841230 20653 raft_consensus.cc:491] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:36.841589 20653 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.848356 20653 raft_consensus.cc:513] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.850729 20727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.851294 20727 raft_consensus.cc:3049] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:36.851353 20653 leader_election.cc:290] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.851680 20727 raft_consensus.cc:738] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.852291 20727 consensus_queue.cc:260] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.851290 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.852998 20805 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.853132 20727 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.857542 20727 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:36.858144 20805 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:36.858616 20617 leader_election.cc:304] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:36.859338 20854 raft_consensus.cc:2798] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:36.859789 20854 raft_consensus.cc:695] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:36.860476 20891 consensus_queue.cc:1035] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.860524 20854 consensus_queue.cc:237] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.870818 20889 consensus_queue.cc:1035] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:09:36.872640 20551 catalog_manager.cc:5526] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 1 to 2, leader changed from 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:36.978868 20891 raft_consensus.cc:988] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:36.979317 20889 raft_consensus.cc:1076] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:36.980494 20653 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "becedfcc2b4f4564857442a1cb7fcfbf"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47254
I20250109 21:09:36.980896 20653 raft_consensus.cc:491] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:36.981145 20653 raft_consensus.cc:3054] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.985466 20653 raft_consensus.cc:513] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.986873 20653 leader_election.cc:290] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:36.987605 20727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "becedfcc2b4f4564857442a1cb7fcfbf" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:36.987934 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "becedfcc2b4f4564857442a1cb7fcfbf" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:36.988206 20727 raft_consensus.cc:3049] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:36.988500 20805 raft_consensus.cc:3054] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.988526 20727 raft_consensus.cc:738] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:36.989385 20727 consensus_queue.cc:260] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:36.990545 20727 raft_consensus.cc:3054] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:36.994760 20805 raft_consensus.cc:2463] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:36.995733 20621 leader_election.cc:304] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:36.996464 20854 raft_consensus.cc:2798] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:36.996738 20727 raft_consensus.cc:2463] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:36.996829 20854 raft_consensus.cc:695] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:36.997700 20854 consensus_queue.cc:237] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:37.004400 20550 catalog_manager.cc:5526] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 1 to 2, leader changed from 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:37.080233 20727 raft_consensus.cc:1270] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.081318 20854 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.085583 20880 raft_consensus.cc:988] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:37.085995 20880 raft_consensus.cc:1076] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:37.088176 20653 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2b14f572654f4e7d92a34209e01df632"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47258
I20250109 21:09:37.088768 20653 raft_consensus.cc:491] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:37.088904 20805 raft_consensus.cc:1270] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.089191 20653 raft_consensus.cc:3054] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:37.090358 20900 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.095968 20653 raft_consensus.cc:513] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:37.097862 20653 leader_election.cc:290] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:37.098445 20727 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b14f572654f4e7d92a34209e01df632" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:37.099022 20727 raft_consensus.cc:3054] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:37.098860 20805 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2b14f572654f4e7d92a34209e01df632" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:37.099493 20805 raft_consensus.cc:3049] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:37.099798 20805 raft_consensus.cc:738] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:37.100548 20805 consensus_queue.cc:260] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:37.101460 20805 raft_consensus.cc:3054] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:37.104331 20727 raft_consensus.cc:2463] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:37.105046 20617 leader_election.cc:304] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:37.105619 20901 raft_consensus.cc:2798] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:37.105988 20901 raft_consensus.cc:695] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:37.106628 20805 raft_consensus.cc:2463] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:37.106623 20901 consensus_queue.cc:237] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:37.111735 20550 catalog_manager.cc:5526] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 1 to 2, leader changed from e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:37.124459 20805 raft_consensus.cc:1270] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.125388 20901 consensus_queue.cc:1035] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.131999 20727 raft_consensus.cc:1270] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.134014 20854 consensus_queue.cc:1035] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.223781 20727 raft_consensus.cc:1270] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.224985 20852 consensus_queue.cc:1035] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.231459 20653 raft_consensus.cc:3054] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:37.237326 20653 raft_consensus.cc:1270] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.238370 20881 consensus_queue.cc:1035] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.266642 20653 raft_consensus.cc:1270] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Refusing update from remote peer 7d1cfc96f0d040b6b8c7e5971c1819e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.267663 20889 consensus_queue.cc:1035] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.273702 20805 raft_consensus.cc:1270] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Refusing update from remote peer 7d1cfc96f0d040b6b8c7e5971c1819e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.274958 20889 consensus_queue.cc:1035] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.392238 20727 raft_consensus.cc:1270] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.393401 20854 consensus_queue.cc:1035] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.400039 20805 raft_consensus.cc:1270] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.401386 20901 consensus_queue.cc:1035] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.408524 20806 raft_consensus.cc:1270] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Refusing update from remote peer 7d1cfc96f0d040b6b8c7e5971c1819e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.409562 20889 consensus_queue.cc:1035] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.413640 20653 raft_consensus.cc:1270] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Refusing update from remote peer 7d1cfc96f0d040b6b8c7e5971c1819e6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.414980 20889 consensus_queue.cc:1035] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.483067 20731 raft_consensus.cc:1270] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.484261 20901 consensus_queue.cc:1035] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.491928 20806 raft_consensus.cc:1270] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.493137 20854 consensus_queue.cc:1035] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.651705 20731 raft_consensus.cc:1270] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.652798 20900 consensus_queue.cc:1035] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:37.660674 20806 raft_consensus.cc:1270] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:37.662983 20900 consensus_queue.cc:1035] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:09:39.584709 20003 auto_leader_rebalancer-test.cc:339] The leader distribution is
I20250109 21:09:39.585321 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:39.600999 20653 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
mode: GRACEFUL
new_leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:44528
I20250109 21:09:39.601524 20653 raft_consensus.cc:604] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Received request to transfer leadership to TS e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:39.603472 20653 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
mode: GRACEFUL
new_leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:44528
I20250109 21:09:39.603906 20653 raft_consensus.cc:604] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Received request to transfer leadership to TS e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:39.604820 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250109 21:09:39.605218 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:40.651842 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:40.661684 20655 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
mode: GRACEFUL
new_leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:44528
I20250109 21:09:40.662213 20655 raft_consensus.cc:604] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Received request to transfer leadership to TS e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:40.668326 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:40.687840 20954 raft_consensus.cc:491] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 670b1b7fdd4640d68f75d69832d02eb1)
I20250109 21:09:40.688566 20954 raft_consensus.cc:513] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:40.690616 20954 leader_election.cc:290] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:40.693477 20653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1" is_pre_election: true
I20250109 21:09:40.712214 20952 raft_consensus.cc:988] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1: : Instructing follower e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:40.712790 20952 raft_consensus.cc:1076] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Signalling peer e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:40.726006 20950 raft_consensus.cc:988] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1: : Instructing follower e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:40.726557 20950 raft_consensus.cc:1076] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Signalling peer e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:40.727463 20805 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:45324
I20250109 21:09:40.728039 20805 raft_consensus.cc:491] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:40.728284 20805 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Advancing to term 3
W20250109 21:09:40.728180 20697 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:40239, user_credentials={real_user=slave}} blocked reactor thread for 54044.4us
I20250109 21:09:40.730965 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4adc5f2899a14e1c95ee79782aa1eaa5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" is_pre_election: true
I20250109 21:09:40.732403 20769 leader_election.cc:304] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e07d8a6ea0f7452a82aa3decda98d38c; no voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6
I20250109 21:09:40.733762 20956 raft_consensus.cc:2743] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:09:40.734537 20805 raft_consensus.cc:513] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:40.735555 20806 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:45324
I20250109 21:09:40.736086 20806 raft_consensus.cc:491] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:40.736348 20806 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:40.739727 20805 leader_election.cc:290] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 3 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:40.740486 20656 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:40.740923 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:40.741148 20656 raft_consensus.cc:3049] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:40.741612 20729 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:40.741649 20656 raft_consensus.cc:738] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:40.741848 20806 raft_consensus.cc:513] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:40.742597 20656 consensus_queue.cc:260] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:40.743793 20806 leader_election.cc:290] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 3 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345)
I20250109 21:09:40.743922 20656 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:40.745577 20653 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:40.745636 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:40.746054 20653 raft_consensus.cc:3049] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:40.746233 20731 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:40.746404 20653 raft_consensus.cc:738] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:40.747316 20729 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 3.
I20250109 21:09:40.747241 20653 consensus_queue.cc:260] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:40.748515 20653 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:40.748520 20769 leader_election.cc:304] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:40.749563 20956 raft_consensus.cc:2798] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:40.750062 20956 raft_consensus.cc:695] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:40.751332 20656 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 3.
I20250109 21:09:40.750900 20956 consensus_queue.cc:237] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:40.752696 20731 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 3.
I20250109 21:09:40.753865 20769 leader_election.cc:304] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:40.754671 20954 raft_consensus.cc:2798] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:40.754815 20653 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 3.
I20250109 21:09:40.755316 20954 raft_consensus.cc:695] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:40.756186 20954 consensus_queue.cc:237] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:40.763909 20552 catalog_manager.cc:5526] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 2 to 3, leader changed from 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193) to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 3 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:40.764950 20552 catalog_manager.cc:5526] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 2 to 3, leader changed from 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193) to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 3 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:41.166203 20653 raft_consensus.cc:1270] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:41.167254 20954 consensus_queue.cc:1035] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:41.175940 20731 raft_consensus.cc:1270] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:41.177510 20954 consensus_queue.cc:1035] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:41.291368 20653 raft_consensus.cc:1270] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:41.292408 20954 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:41.300058 20731 raft_consensus.cc:1270] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:41.301770 20956 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:41.669358 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:41.674764 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:41.675168 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20250109 21:09:41.709120 20827 debug-util.cc:398] Leaking SignalData structure 0x7b08000703a0 after lost signal to thread 20006
W20250109 21:09:41.710052 20827 debug-util.cc:398] Leaking SignalData structure 0x7b08000c5240 after lost signal to thread 20586
W20250109 21:09:41.710860 20827 debug-util.cc:398] Leaking SignalData structure 0x7b08001fbf20 after lost signal to thread 20680
W20250109 21:09:41.711654 20827 debug-util.cc:398] Leaking SignalData structure 0x7b08000a52c0 after lost signal to thread 20756
W20250109 21:09:41.712348 20827 debug-util.cc:398] Leaking SignalData structure 0x7b080009fc20 after lost signal to thread 20830
I20250109 21:09:42.675884 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:42.681149 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:42.681533 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:43.682289 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:43.689033 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:43.689411 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:44.690400 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:44.695659 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:44.696013 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:45.696655 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:45.701443 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:45.701797 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:46.702561 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:46.707576 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:46.707901 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:47.708539 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:47.713405 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:47.713723 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:48.714529 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:48.719949 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:48.720337 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:49.896574 20003 auto_leader_rebalancer-test.cc:358] The leader distribution is
I20250109 21:09:49.901007 20806 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:45338
I20250109 21:09:49.901883 20806 raft_consensus.cc:604] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:49.912782 20806 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:45338
I20250109 21:09:49.913213 20806 raft_consensus.cc:604] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:49.917026 20729 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1af768b40f134f1a928ae54f64796392"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:48110
I20250109 21:09:49.917408 20729 raft_consensus.cc:604] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:49.921360 20729 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:48110
I20250109 21:09:49.921797 20729 raft_consensus.cc:604] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
I20250109 21:09:49.926288 20729 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
mode: GRACEFUL
new_leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:48110
I20250109 21:09:49.926689 20729 raft_consensus.cc:604] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Received request to transfer leadership to TS 670b1b7fdd4640d68f75d69832d02eb1
W20250109 21:09:49.953117 20827 debug-util.cc:398] Leaking SignalData structure 0x7b08000a0e40 after lost signal to thread 20006
W20250109 21:09:49.953805 20827 debug-util.cc:398] Leaking SignalData structure 0x7b08001b7120 after lost signal to thread 20586
W20250109 21:09:49.954537 20827 debug-util.cc:398] Leaking SignalData structure 0x7b08001dccc0 after lost signal to thread 20680
W20250109 21:09:49.955210 20827 debug-util.cc:398] Leaking SignalData structure 0x7b0800132c80 after lost signal to thread 20756
W20250109 21:09:49.955821 20827 debug-util.cc:398] Leaking SignalData structure 0x7b0800203b60 after lost signal to thread 20830
I20250109 21:09:50.046166 20956 raft_consensus.cc:988] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.046715 20979 raft_consensus.cc:1076] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.048099 20655 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47258
I20250109 21:09:50.048506 20655 raft_consensus.cc:491] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:50.048823 20655 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:50.053761 20655 raft_consensus.cc:513] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:50.055428 20655 leader_election.cc:290] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 4 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:50.056393 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:50.056296 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:50.056999 20806 raft_consensus.cc:3049] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:09:50.057075 20729 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:50.057268 20806 raft_consensus.cc:738] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:50.057919 20806 consensus_queue.cc:260] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:50.058732 20806 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:50.061591 20729 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 4.
I20250109 21:09:50.062564 20617 leader_election.cc:304] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:50.062994 20806 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 4.
I20250109 21:09:50.063361 20952 raft_consensus.cc:2798] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:09:50.064321 20952 raft_consensus.cc:695] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:50.065032 20952 consensus_queue.cc:237] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:50.073491 20550 catalog_manager.cc:5526] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 3 to 4, leader changed from e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 4 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:50.097647 20976 raft_consensus.cc:988] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.098088 20978 raft_consensus.cc:1076] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.099258 20655 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47254
I20250109 21:09:50.099675 20655 raft_consensus.cc:491] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:50.099947 20655 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:50.104333 20655 raft_consensus.cc:513] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.105619 20655 leader_election.cc:290] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 3 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:50.106281 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:50.106447 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:50.106878 20806 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:50.106842 20729 raft_consensus.cc:3049] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:50.107352 20729 raft_consensus.cc:738] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:50.108139 20729 consensus_queue.cc:260] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.109392 20729 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:50.112723 20976 raft_consensus.cc:988] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.112874 20806 raft_consensus.cc:2463] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 3.
I20250109 21:09:50.113118 20978 raft_consensus.cc:1076] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.114465 20655 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1af768b40f134f1a928ae54f64796392"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47254
I20250109 21:09:50.114395 20621 leader_election.cc:304] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:50.114981 20655 raft_consensus.cc:491] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:50.115384 20952 raft_consensus.cc:2798] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:50.115406 20655 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:50.115491 20729 raft_consensus.cc:2463] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 3.
I20250109 21:09:50.116040 20952 raft_consensus.cc:695] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:50.117029 20952 consensus_queue.cc:237] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.122241 20655 raft_consensus.cc:513] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.124099 20655 leader_election.cc:290] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:50.124894 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:50.125447 20731 raft_consensus.cc:3049] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:09:50.125773 20731 raft_consensus.cc:738] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:50.123485 20550 catalog_manager.cc:5526] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 2 to 3, leader changed from 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:50.126600 20731 consensus_queue.cc:260] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.127210 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:50.127694 20806 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:50.127909 20731 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:09:50.131973 20806 raft_consensus.cc:2463] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:50.134635 20621 leader_election.cc:304] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:50.135362 20952 raft_consensus.cc:2798] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:09:50.135846 20952 raft_consensus.cc:695] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:50.136823 20979 raft_consensus.cc:988] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.136679 20731 raft_consensus.cc:2463] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 2.
I20250109 21:09:50.137404 20956 raft_consensus.cc:1076] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.136679 20952 consensus_queue.cc:237] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.138633 20655 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47258
I20250109 21:09:50.139092 20655 raft_consensus.cc:491] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:50.139405 20655 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:50.144052 20550 catalog_manager.cc:5526] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 1 to 2, leader changed from 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:50.145560 20655 raft_consensus.cc:513] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.147190 20655 leader_election.cc:290] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 4 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:50.147878 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:50.148109 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b39a53ae62547029a75aa38767f4414" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:50.148473 20731 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:50.148666 20806 raft_consensus.cc:3049] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:09:50.149927 20806 raft_consensus.cc:738] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:50.150660 20806 consensus_queue.cc:260] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.151871 20806 raft_consensus.cc:3054] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:50.153170 20731 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 4.
I20250109 21:09:50.153976 20617 leader_election.cc:304] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, 7d1cfc96f0d040b6b8c7e5971c1819e6; no voters:
I20250109 21:09:50.154583 20952 raft_consensus.cc:2798] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:09:50.155062 20952 raft_consensus.cc:695] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:50.155897 20952 consensus_queue.cc:237] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.156961 20806 raft_consensus.cc:2463] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 4.
I20250109 21:09:50.162344 20550 catalog_manager.cc:5526] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 3 to 4, leader changed from e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 4 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:50.188522 20976 raft_consensus.cc:988] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: : Instructing follower 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.188916 20978 raft_consensus.cc:1076] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Signalling peer 670b1b7fdd4640d68f75d69832d02eb1 to start an election
I20250109 21:09:50.190187 20655 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
from {username='slave'} at 127.0.0.1:47254
I20250109 21:09:50.190654 20655 raft_consensus.cc:491] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:50.191008 20655 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:50.195255 20655 raft_consensus.cc:513] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.196550 20655 leader_election.cc:290] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 3 election: Requested vote from peers 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:50.197297 20731 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:50.197404 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "670b1b7fdd4640d68f75d69832d02eb1" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:50.197824 20731 raft_consensus.cc:3049] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:50.197860 20806 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:50.198170 20731 raft_consensus.cc:738] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:50.198835 20731 consensus_queue.cc:260] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.199988 20731 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:50.201894 20806 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 3.
I20250109 21:09:50.202649 20621 leader_election.cc:304] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 670b1b7fdd4640d68f75d69832d02eb1, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:50.203392 20952 raft_consensus.cc:2798] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:50.203760 20952 raft_consensus.cc:695] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Becoming Leader. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:50.204234 20731 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 670b1b7fdd4640d68f75d69832d02eb1 in term 3.
I20250109 21:09:50.204478 20952 consensus_queue.cc:237] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:50.210873 20550 catalog_manager.cc:5526] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 reported cstate change: term changed from 2 to 3, leader changed from 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194) to 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "670b1b7fdd4640d68f75d69832d02eb1" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:50.477916 20731 raft_consensus.cc:1270] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:50.479041 20952 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:09:50.488037 20806 raft_consensus.cc:1270] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:50.489650 20980 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:09:50.605966 20731 raft_consensus.cc:1270] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:50.607088 20980 consensus_queue.cc:1035] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:50.615324 20806 raft_consensus.cc:1270] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:50.617461 20952 consensus_queue.cc:1035] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:50.618873 20731 raft_consensus.cc:1270] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:50.620394 20952 consensus_queue.cc:1035] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:50.621359 20731 raft_consensus.cc:1270] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:50.626744 20952 consensus_queue.cc:1035] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:09:50.637387 20806 raft_consensus.cc:1270] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:09:50.638022 20805 raft_consensus.cc:1270] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:50.638782 20996 consensus_queue.cc:1035] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:09:50.639425 20980 consensus_queue.cc:1035] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:09:50.693534 20806 raft_consensus.cc:1270] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:50.694614 20980 consensus_queue.cc:1035] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:50.702505 20729 raft_consensus.cc:1270] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Refusing update from remote peer 670b1b7fdd4640d68f75d69832d02eb1: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:50.704154 20996 consensus_queue.cc:1035] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:52.956638 20003 auto_leader_rebalancer-test.cc:373] The leader distribution is
I20250109 21:09:52.957258 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:52.963727 20655 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
mode: GRACEFUL
new_leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
from {username='slave'} at 127.0.0.1:44528
I20250109 21:09:52.964190 20655 raft_consensus.cc:604] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 LEADER]: Received request to transfer leadership to TS 7d1cfc96f0d040b6b8c7e5971c1819e6
I20250109 21:09:52.966090 20655 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
mode: GRACEFUL
new_leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:44528
I20250109 21:09:52.966456 20655 raft_consensus.cc:604] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Received request to transfer leadership to TS e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:52.968216 20655 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1af768b40f134f1a928ae54f64796392"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
mode: GRACEFUL
new_leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
from {username='slave'} at 127.0.0.1:44528
I20250109 21:09:52.968581 20655 raft_consensus.cc:604] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Received request to transfer leadership to TS 7d1cfc96f0d040b6b8c7e5971c1819e6
I20250109 21:09:52.970276 20655 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47"
dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
mode: GRACEFUL
new_leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:44528
I20250109 21:09:52.970667 20655 raft_consensus.cc:604] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Received request to transfer leadership to TS e07d8a6ea0f7452a82aa3decda98d38c
I20250109 21:09:52.971448 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20250109 21:09:52.971789 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:53.022426 20980 raft_consensus.cc:988] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1: : Instructing follower e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:53.022874 21005 raft_consensus.cc:1076] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Signalling peer e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:53.024104 20806 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:45324
I20250109 21:09:53.024469 20806 raft_consensus.cc:491] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:53.024677 20806 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:53.028533 20806 raft_consensus.cc:513] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.030010 20806 leader_election.cc:290] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 4 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:53.030877 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:53.030946 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d8c47ba51cf3462697faafec02851e47" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:53.031528 20655 raft_consensus.cc:3049] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:09:53.031599 20729 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:53.031965 20655 raft_consensus.cc:738] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:53.032817 20655 consensus_queue.cc:260] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.034068 20655 raft_consensus.cc:3054] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:53.036252 20729 raft_consensus.cc:2463] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 4.
I20250109 21:09:53.037107 20769 leader_election.cc:304] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:53.037668 21006 raft_consensus.cc:2798] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:09:53.038622 21006 raft_consensus.cc:695] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:53.039279 20655 raft_consensus.cc:2463] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 4.
I20250109 21:09:53.039552 21006 consensus_queue.cc:237] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.045599 20550 catalog_manager.cc:5526] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 3 to 4, leader changed from 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193) to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 4 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:53.253834 20980 raft_consensus.cc:988] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1: : Instructing follower 7d1cfc96f0d040b6b8c7e5971c1819e6 to start an election
I20250109 21:09:53.254243 21005 raft_consensus.cc:1076] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Signalling peer 7d1cfc96f0d040b6b8c7e5971c1819e6 to start an election
I20250109 21:09:53.255354 20729 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1af768b40f134f1a928ae54f64796392"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
from {username='slave'} at 127.0.0.1:48100
I20250109 21:09:53.255724 20729 raft_consensus.cc:491] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:53.255952 20729 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:53.259809 20729 raft_consensus.cc:513] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.261729 20729 leader_election.cc:290] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 3 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239)
I20250109 21:09:53.262269 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:53.262549 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1af768b40f134f1a928ae54f64796392" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:53.262814 20655 raft_consensus.cc:3049] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:09:53.263085 20806 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:53.263187 20655 raft_consensus.cc:738] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:53.263844 20655 consensus_queue.cc:260] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.264649 20655 raft_consensus.cc:3054] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:09:53.266733 20806 raft_consensus.cc:2463] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 3.
I20250109 21:09:53.267668 20697 leader_election.cc:304] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:53.268357 20978 raft_consensus.cc:2798] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:09:53.268841 20655 raft_consensus.cc:2463] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 3.
I20250109 21:09:53.269505 20978 raft_consensus.cc:695] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:53.270287 20978 consensus_queue.cc:237] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.275569 20550 catalog_manager.cc:5526] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 2 to 3, leader changed from 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193) to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 3 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:53.298612 20980 raft_consensus.cc:988] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1: : Instructing follower e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:53.298983 21005 raft_consensus.cc:1076] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Signalling peer e07d8a6ea0f7452a82aa3decda98d38c to start an election
I20250109 21:09:53.300128 20806 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5"
dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
from {username='slave'} at 127.0.0.1:45324
I20250109 21:09:53.300530 20806 raft_consensus.cc:491] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:53.300743 20806 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:53.304458 20806 raft_consensus.cc:513] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.305567 20806 leader_election.cc:290] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 4 election: Requested vote from peers 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345), 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583)
I20250109 21:09:53.306309 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:53.306408 20729 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "108b9ff6a92049a1824c85dc4a2635f5" candidate_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
I20250109 21:09:53.306957 20655 raft_consensus.cc:3049] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:09:53.307018 20729 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:53.307200 20655 raft_consensus.cc:738] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:53.307744 20655 consensus_queue.cc:260] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.308638 20655 raft_consensus.cc:3054] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:09:53.311065 20980 raft_consensus.cc:988] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1: : Instructing follower 7d1cfc96f0d040b6b8c7e5971c1819e6 to start an election
I20250109 21:09:53.311527 21005 raft_consensus.cc:1076] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 LEADER]: Signalling peer 7d1cfc96f0d040b6b8c7e5971c1819e6 to start an election
I20250109 21:09:53.312062 20729 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 4.
I20250109 21:09:53.312834 20769 leader_election.cc:304] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:53.312901 20729 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3"
dest_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6"
from {username='slave'} at 127.0.0.1:48100
I20250109 21:09:53.313369 20729 raft_consensus.cc:491] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:09:53.313364 21006 raft_consensus.cc:2798] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:09:53.313843 20729 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Advancing to term 5
I20250109 21:09:53.313984 21006 raft_consensus.cc:695] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 LEADER]: Becoming Leader. State: Replica: e07d8a6ea0f7452a82aa3decda98d38c, State: Running, Role: LEADER
I20250109 21:09:53.314867 20655 raft_consensus.cc:2463] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e07d8a6ea0f7452a82aa3decda98d38c in term 4.
I20250109 21:09:53.315023 21006 consensus_queue.cc:237] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } }
I20250109 21:09:53.318346 20729 raft_consensus.cc:513] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 5 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:53.320415 20806 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "e07d8a6ea0f7452a82aa3decda98d38c"
I20250109 21:09:53.320606 20729 leader_election.cc:290] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 5 election: Requested vote from peers e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195:40239), 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345)
I20250109 21:09:53.320847 20806 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Advancing to term 5
I20250109 21:09:53.320819 20655 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "04dc56331ff84f7e80857e713422faf3" candidate_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" candidate_term: 5 candidate_status { last_received { term: 4 index: 4 } } ignore_live_leader: true dest_uuid: "670b1b7fdd4640d68f75d69832d02eb1"
I20250109 21:09:53.321441 20655 raft_consensus.cc:3049] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 LEADER]: Stepping down as leader of term 4
I20250109 21:09:53.321702 20655 raft_consensus.cc:738] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 LEADER]: Becoming Follower/Learner. State: Replica: 670b1b7fdd4640d68f75d69832d02eb1, State: Running, Role: LEADER
I20250109 21:09:53.322193 20655 consensus_queue.cc:260] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 4, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:53.322912 20655 raft_consensus.cc:3054] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Advancing to term 5
I20250109 21:09:53.322341 20550 catalog_manager.cc:5526] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c reported cstate change: term changed from 3 to 4, leader changed from 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193) to e07d8a6ea0f7452a82aa3decda98d38c (127.19.136.195). New cstate: current_term: 4 leader_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: HEALTHY } } }
I20250109 21:09:53.325762 20806 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 5.
I20250109 21:09:53.326483 20697 leader_election.cc:304] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [CANDIDATE]: Term 5 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 7d1cfc96f0d040b6b8c7e5971c1819e6, e07d8a6ea0f7452a82aa3decda98d38c; no voters:
I20250109 21:09:53.327003 20978 raft_consensus.cc:2798] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 5 FOLLOWER]: Leader election won for term 5
I20250109 21:09:53.327412 20978 raft_consensus.cc:695] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 5 LEADER]: Becoming Leader. State: Replica: 7d1cfc96f0d040b6b8c7e5971c1819e6, State: Running, Role: LEADER
I20250109 21:09:53.328074 20655 raft_consensus.cc:2463] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 5 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 7d1cfc96f0d040b6b8c7e5971c1819e6 in term 5.
I20250109 21:09:53.328150 20978 consensus_queue.cc:237] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 4.4, Last appended by leader: 4, Current term: 5, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } }
I20250109 21:09:53.335526 20550 catalog_manager.cc:5526] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 reported cstate change: term changed from 4 to 5, leader changed from 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193) to 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194). New cstate: current_term: 5 leader_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 } health_report { overall_health: UNKNOWN } } }
I20250109 21:09:53.508112 20655 raft_consensus.cc:1270] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:53.509110 21006 consensus_queue.cc:1035] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:09:53.518235 20729 raft_consensus.cc:1270] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:53.519593 21020 consensus_queue.cc:1035] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:09:53.756372 20655 raft_consensus.cc:1270] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Refusing update from remote peer 7d1cfc96f0d040b6b8c7e5971c1819e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:53.757359 20978 consensus_queue.cc:1035] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:53.764729 20806 raft_consensus.cc:1270] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Refusing update from remote peer 7d1cfc96f0d040b6b8c7e5971c1819e6: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:09:53.767241 21025 consensus_queue.cc:1035] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:09:53.845279 20806 raft_consensus.cc:1270] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 5 FOLLOWER]: Refusing update from remote peer 7d1cfc96f0d040b6b8c7e5971c1819e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250109 21:09:53.846802 21025 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e07d8a6ea0f7452a82aa3decda98d38c" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 40239 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:09:53.856410 20655 raft_consensus.cc:1270] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 5 FOLLOWER]: Refusing update from remote peer 7d1cfc96f0d040b6b8c7e5971c1819e6: Log matching property violated. Preceding OpId in replica: term: 4 index: 4. Preceding OpId from leader: term: 5 index: 5. (index mismatch)
I20250109 21:09:53.859278 20978 consensus_queue.cc:1035] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:09:53.867149 20729 raft_consensus.cc:1270] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:53.868963 21020 consensus_queue.cc:1035] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "7d1cfc96f0d040b6b8c7e5971c1819e6" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34583 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:09:53.880242 20655 raft_consensus.cc:1270] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Refusing update from remote peer e07d8a6ea0f7452a82aa3decda98d38c: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:09:53.882016 21020 consensus_queue.cc:1035] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [LEADER]: Connected to new peer: Peer: permanent_uuid: "670b1b7fdd4640d68f75d69832d02eb1" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 37345 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:09:53.972651 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:53.977737 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:53.978066 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:54.978713 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:54.983815 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:54.984158 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:55.984869 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:55.989738 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:55.990063 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:56.990947 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:56.996093 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:56.996464 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:57.997220 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:58.002153 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:58.002514 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:09:59.003290 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:09:59.008862 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:09:59.009224 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:00.009838 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:00.014564 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:10:00.014876 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:01.015586 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:01.020556 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:10:01.020897 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:02.021566 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:02.026975 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:10:02.027441 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:03.053762 20003 auto_leader_rebalancer-test.cc:384] The leader distribution is
I20250109 21:10:03.054235 20003 tablet_server.cc:178] TabletServer@127.19.136.193:0 shutting down...
I20250109 21:10:03.078534 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:10:03.079164 20003 tablet_replica.cc:331] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.079761 20003 raft_consensus.cc:2238] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.080626 20003 raft_consensus.cc:2267] T 8b39a53ae62547029a75aa38767f4414 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.083190 20003 tablet_replica.cc:331] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.084079 20003 raft_consensus.cc:2238] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.084465 20003 raft_consensus.cc:2267] T d8c47ba51cf3462697faafec02851e47 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.086174 20003 tablet_replica.cc:331] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.086620 20003 raft_consensus.cc:2238] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.087016 20003 raft_consensus.cc:2267] T 743d96d61f80409e9d57a2f42370c07a P 670b1b7fdd4640d68f75d69832d02eb1 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.088577 20003 tablet_replica.cc:331] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.089017 20003 raft_consensus.cc:2238] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.089697 20003 raft_consensus.cc:2267] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.091396 20003 tablet_replica.cc:331] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.091840 20003 raft_consensus.cc:2238] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.092485 20003 raft_consensus.cc:2267] T becedfcc2b4f4564857442a1cb7fcfbf P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.094022 20003 tablet_replica.cc:331] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.094439 20003 raft_consensus.cc:2238] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.094821 20003 raft_consensus.cc:2267] T d387b5362a59432b99d59665897882d0 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.096338 20003 tablet_replica.cc:331] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.096760 20003 raft_consensus.cc:2238] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.097086 20003 raft_consensus.cc:2267] T 108b9ff6a92049a1824c85dc4a2635f5 P 670b1b7fdd4640d68f75d69832d02eb1 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.098359 20003 tablet_replica.cc:331] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.098742 20003 raft_consensus.cc:2238] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.099156 20003 raft_consensus.cc:2267] T 1af768b40f134f1a928ae54f64796392 P 670b1b7fdd4640d68f75d69832d02eb1 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.100735 20003 tablet_replica.cc:331] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.101159 20003 raft_consensus.cc:2238] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.101841 20003 raft_consensus.cc:2267] T 2b14f572654f4e7d92a34209e01df632 P 670b1b7fdd4640d68f75d69832d02eb1 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.103852 20003 tablet_replica.cc:331] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1: stopping tablet replica
I20250109 21:10:03.104429 20003 raft_consensus.cc:2238] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 5 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.104873 20003 raft_consensus.cc:2267] T 04dc56331ff84f7e80857e713422faf3 P 670b1b7fdd4640d68f75d69832d02eb1 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.133958 20003 tablet_server.cc:195] TabletServer@127.19.136.193:0 shutdown complete.
I20250109 21:10:03.152424 20003 tablet_server.cc:178] TabletServer@127.19.136.194:0 shutting down...
W20250109 21:10:03.158983 20769 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 4 similar messages]
W20250109 21:10:03.165073 20769 consensus_peers.cc:487] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c -> Peer 7d1cfc96f0d040b6b8c7e5971c1819e6 (127.19.136.194:34583): Couldn't send request to peer 7d1cfc96f0d040b6b8c7e5971c1819e6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:03.179693 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:10:03.180619 20003 tablet_replica.cc:331] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.181275 20003 raft_consensus.cc:2238] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 5 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.182000 20003 raft_consensus.cc:2267] T 04dc56331ff84f7e80857e713422faf3 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 5 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.183713 20003 tablet_replica.cc:331] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.184222 20003 raft_consensus.cc:2238] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.184605 20003 raft_consensus.cc:2267] T 8b39a53ae62547029a75aa38767f4414 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.186132 20003 tablet_replica.cc:331] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.186594 20003 raft_consensus.cc:2238] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.187006 20003 raft_consensus.cc:2267] T 2b14f572654f4e7d92a34209e01df632 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.188583 20003 tablet_replica.cc:331] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.189019 20003 raft_consensus.cc:2238] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.189378 20003 raft_consensus.cc:2267] T 108b9ff6a92049a1824c85dc4a2635f5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.190804 20003 tablet_replica.cc:331] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.191315 20003 raft_consensus.cc:2238] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.191988 20003 raft_consensus.cc:2267] T 1af768b40f134f1a928ae54f64796392 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.193507 20003 tablet_replica.cc:331] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.194001 20003 raft_consensus.cc:2238] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.194411 20003 raft_consensus.cc:2267] T d387b5362a59432b99d59665897882d0 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.195976 20003 tablet_replica.cc:331] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.196441 20003 raft_consensus.cc:2238] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.196796 20003 raft_consensus.cc:2267] T becedfcc2b4f4564857442a1cb7fcfbf P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.198360 20003 tablet_replica.cc:331] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.198781 20003 raft_consensus.cc:2238] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.199174 20003 raft_consensus.cc:2267] T 4adc5f2899a14e1c95ee79782aa1eaa5 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.200739 20003 tablet_replica.cc:331] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.201133 20003 raft_consensus.cc:2238] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.201772 20003 raft_consensus.cc:2267] T 743d96d61f80409e9d57a2f42370c07a P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.203323 20003 tablet_replica.cc:331] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6: stopping tablet replica
I20250109 21:10:03.203701 20003 raft_consensus.cc:2238] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.204036 20003 raft_consensus.cc:2267] T d8c47ba51cf3462697faafec02851e47 P 7d1cfc96f0d040b6b8c7e5971c1819e6 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.231002 20003 tablet_server.cc:195] TabletServer@127.19.136.194:0 shutdown complete.
W20250109 21:10:03.235728 20769 consensus_peers.cc:487] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c -> Peer 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345): Couldn't send request to peer 670b1b7fdd4640d68f75d69832d02eb1. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:37345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:03.249962 20003 tablet_server.cc:178] TabletServer@127.19.136.195:0 shutting down...
W20250109 21:10:03.274106 20769 consensus_peers.cc:487] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c -> Peer 670b1b7fdd4640d68f75d69832d02eb1 (127.19.136.193:37345): Couldn't send request to peer 670b1b7fdd4640d68f75d69832d02eb1. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:37345: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:03.277083 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:10:03.277676 20003 tablet_replica.cc:331] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.278219 20003 raft_consensus.cc:2238] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.278604 20003 raft_consensus.cc:2267] T becedfcc2b4f4564857442a1cb7fcfbf P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.280323 20003 tablet_replica.cc:331] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.280771 20003 raft_consensus.cc:2238] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 5 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.281127 20003 raft_consensus.cc:2267] T 04dc56331ff84f7e80857e713422faf3 P e07d8a6ea0f7452a82aa3decda98d38c [term 5 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.282578 20003 tablet_replica.cc:331] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.283339 20003 raft_consensus.cc:2238] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.283890 20003 raft_consensus.cc:2267] T 8b39a53ae62547029a75aa38767f4414 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.285606 20003 tablet_replica.cc:331] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.286038 20003 raft_consensus.cc:2238] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.286365 20003 raft_consensus.cc:2267] T 743d96d61f80409e9d57a2f42370c07a P e07d8a6ea0f7452a82aa3decda98d38c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.287933 20003 tablet_replica.cc:331] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.288417 20003 raft_consensus.cc:2238] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.288758 20003 raft_consensus.cc:2267] T 4adc5f2899a14e1c95ee79782aa1eaa5 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.290287 20003 tablet_replica.cc:331] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.290735 20003 raft_consensus.cc:2238] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.291417 20003 raft_consensus.cc:2267] T d8c47ba51cf3462697faafec02851e47 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.292826 20003 tablet_replica.cc:331] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.293226 20003 raft_consensus.cc:2238] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.293895 20003 raft_consensus.cc:2267] T d387b5362a59432b99d59665897882d0 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.295447 20003 tablet_replica.cc:331] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.295917 20003 raft_consensus.cc:2238] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.296263 20003 raft_consensus.cc:2267] T 1af768b40f134f1a928ae54f64796392 P e07d8a6ea0f7452a82aa3decda98d38c [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.297729 20003 tablet_replica.cc:331] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.298136 20003 raft_consensus.cc:2238] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.298774 20003 raft_consensus.cc:2267] T 108b9ff6a92049a1824c85dc4a2635f5 P e07d8a6ea0f7452a82aa3decda98d38c [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.300230 20003 tablet_replica.cc:331] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c: stopping tablet replica
I20250109 21:10:03.300607 20003 raft_consensus.cc:2238] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:03.300959 20003 raft_consensus.cc:2267] T 2b14f572654f4e7d92a34209e01df632 P e07d8a6ea0f7452a82aa3decda98d38c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.346109 20003 tablet_server.cc:195] TabletServer@127.19.136.195:0 shutdown complete.
I20250109 21:10:03.365892 20003 master.cc:537] Master@127.19.136.254:39205 shutting down...
I20250109 21:10:03.387436 20003 raft_consensus.cc:2238] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:03.387972 20003 raft_consensus.cc:2267] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:03.388275 20003 tablet_replica.cc:331] T 00000000000000000000000000000000 P efff753480c14485a5c541f66c4c8ced: stopping tablet replica
I20250109 21:10:03.407151 20003 master.cc:559] Master@127.19.136.254:39205 shutdown complete.
670b1b7fdd4640d68f75d69832d02eb1 5
7d1cfc96f0d040b6b8c7e5971c1819e6 4
e07d8a6ea0f7452a82aa3decda98d38c 1
670b1b7fdd4640d68f75d69832d02eb1 3
7d1cfc96f0d040b6b8c7e5971c1819e6 4
e07d8a6ea0f7452a82aa3decda98d38c 3
670b1b7fdd4640d68f75d69832d02eb1 8
7d1cfc96f0d040b6b8c7e5971c1819e6 1
e07d8a6ea0f7452a82aa3decda98d38c 1
670b1b7fdd4640d68f75d69832d02eb1 4
7d1cfc96f0d040b6b8c7e5971c1819e6 3
e07d8a6ea0f7452a82aa3decda98d38c 3
[ OK ] LeaderRebalancerTest.FunctionalTestForNotDivided (28702 ms)
[ RUN ] LeaderRebalancerTest.AddTserver
I20250109 21:10:03.446434 20003 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.136.254:44891
I20250109 21:10:03.447516 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:03.452708 21044 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:03.453456 21045 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:03.453799 21047 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:03.454697 20003 server_base.cc:1034] running on GCE node
I20250109 21:10:03.455551 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:10:03.455734 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:03.455878 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457003455860 us; error 0 us; skew 500 ppm
I20250109 21:10:03.456360 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:03.465400 20003 webserver.cc:458] Webserver started at http://127.19.136.254:46593/ using document root <none> and password file <none>
I20250109 21:10:03.465857 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:03.466020 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:03.466285 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:03.467445 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/master-0-root/instance:
uuid: "b6f074c68ddf4e09bcad877ccc2bfc45"
format_stamp: "Formatted at 2025-01-09 21:10:03 on dist-test-slave-sc47"
I20250109 21:10:03.471671 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.001s sys 0.004s
I20250109 21:10:03.474581 21052 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.475270 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250109 21:10:03.475533 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/master-0-root
uuid: "b6f074c68ddf4e09bcad877ccc2bfc45"
format_stamp: "Formatted at 2025-01-09 21:10:03 on dist-test-slave-sc47"
I20250109 21:10:03.475790 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:03.499027 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:03.500263 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:03.536671 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.254:44891
I20250109 21:10:03.536768 21103 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.254:44891 every 8 connection(s)
I20250109 21:10:03.540416 21104 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:03.549767 21104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45: Bootstrap starting.
I20250109 21:10:03.554227 21104 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:03.558193 21104 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45: No bootstrap required, opened a new log
I20250109 21:10:03.560101 21104 raft_consensus.cc:357] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6f074c68ddf4e09bcad877ccc2bfc45" member_type: VOTER }
I20250109 21:10:03.560499 21104 raft_consensus.cc:383] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:03.560678 21104 raft_consensus.cc:738] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: b6f074c68ddf4e09bcad877ccc2bfc45, State: Initialized, Role: FOLLOWER
I20250109 21:10:03.561208 21104 consensus_queue.cc:260] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6f074c68ddf4e09bcad877ccc2bfc45" member_type: VOTER }
I20250109 21:10:03.561607 21104 raft_consensus.cc:397] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250109 21:10:03.561787 21104 raft_consensus.cc:491] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250109 21:10:03.562008 21104 raft_consensus.cc:3054] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:03.565770 21104 raft_consensus.cc:513] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6f074c68ddf4e09bcad877ccc2bfc45" member_type: VOTER }
I20250109 21:10:03.566215 21104 leader_election.cc:304] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: b6f074c68ddf4e09bcad877ccc2bfc45; no voters:
I20250109 21:10:03.567294 21104 leader_election.cc:290] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250109 21:10:03.567637 21107 raft_consensus.cc:2798] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:03.568913 21107 raft_consensus.cc:695] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 1 LEADER]: Becoming Leader. State: Replica: b6f074c68ddf4e09bcad877ccc2bfc45, State: Running, Role: LEADER
I20250109 21:10:03.569571 21107 consensus_queue.cc:237] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6f074c68ddf4e09bcad877ccc2bfc45" member_type: VOTER }
I20250109 21:10:03.570228 21104 sys_catalog.cc:564] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [sys.catalog]: configured and running, proceeding with master startup.
I20250109 21:10:03.574976 21109 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [sys.catalog]: SysCatalogTable state changed. Reason: New leader b6f074c68ddf4e09bcad877ccc2bfc45. Latest consensus state: current_term: 1 leader_uuid: "b6f074c68ddf4e09bcad877ccc2bfc45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6f074c68ddf4e09bcad877ccc2bfc45" member_type: VOTER } }
I20250109 21:10:03.575469 21109 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [sys.catalog]: This master's current role is: LEADER
I20250109 21:10:03.577214 21114 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250109 21:10:03.576860 21108 sys_catalog.cc:455] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "b6f074c68ddf4e09bcad877ccc2bfc45" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "b6f074c68ddf4e09bcad877ccc2bfc45" member_type: VOTER } }
I20250109 21:10:03.577498 21108 sys_catalog.cc:458] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [sys.catalog]: This master's current role is: LEADER
I20250109 21:10:03.582870 21114 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250109 21:10:03.587126 20003 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250109 21:10:03.591195 21114 catalog_manager.cc:1348] Generated new cluster ID: 3a949fd244404721a6ab0fcbfd9e05de
I20250109 21:10:03.591459 21114 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250109 21:10:03.617749 21114 catalog_manager.cc:1371] Generated new certificate authority record
I20250109 21:10:03.618974 21114 catalog_manager.cc:1505] Loading token signing keys...
I20250109 21:10:03.633663 21114 catalog_manager.cc:5899] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45: Generated new TSK 0
I20250109 21:10:03.634212 21114 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250109 21:10:03.653122 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:03.659116 21125 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:03.660475 21126 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:03.661937 20003 server_base.cc:1034] running on GCE node
W20250109 21:10:03.662817 21128 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:03.663700 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:10:03.663882 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:03.664049 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457003664029 us; error 0 us; skew 500 ppm
I20250109 21:10:03.664546 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:03.666810 20003 webserver.cc:458] Webserver started at http://127.19.136.193:33707/ using document root <none> and password file <none>
I20250109 21:10:03.667315 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:03.667503 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:03.667743 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:03.668859 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/instance:
uuid: "1774487f18694af1a5340fc8486cff53"
format_stamp: "Formatted at 2025-01-09 21:10:03 on dist-test-slave-sc47"
I20250109 21:10:03.673142 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250109 21:10:03.676157 21133 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.676808 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:10:03.677055 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
uuid: "1774487f18694af1a5340fc8486cff53"
format_stamp: "Formatted at 2025-01-09 21:10:03 on dist-test-slave-sc47"
I20250109 21:10:03.677366 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:03.692479 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:03.693558 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:03.694859 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:10:03.696903 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:10:03.697113 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.697333 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:10:03.697489 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.734987 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.193:33243
I20250109 21:10:03.735085 21196 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.193:33243 every 8 connection(s)
I20250109 21:10:03.739223 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:03.746513 21201 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:03.747516 21202 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:03.748860 21205 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:03.750836 20003 server_base.cc:1034] running on GCE node
I20250109 21:10:03.752395 21197 heartbeater.cc:346] Connected to a master server at 127.19.136.254:44891
I20250109 21:10:03.752490 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20250109 21:10:03.752689 21197 heartbeater.cc:463] Registering TS with master...
W20250109 21:10:03.752743 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:03.753011 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457003752993 us; error 0 us; skew 500 ppm
I20250109 21:10:03.753543 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:03.753494 21197 heartbeater.cc:510] Master 127.19.136.254:44891 requested a full tablet report, sending...
I20250109 21:10:03.755820 21069 ts_manager.cc:194] Registered new tserver with Master: 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:03.756074 20003 webserver.cc:458] Webserver started at http://127.19.136.194:42361/ using document root <none> and password file <none>
I20250109 21:10:03.756588 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:03.756772 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:03.757005 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:03.757620 21069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60980
I20250109 21:10:03.758126 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/instance:
uuid: "f5d1eaae36f84176860e3799d49e4f53"
format_stamp: "Formatted at 2025-01-09 21:10:03 on dist-test-slave-sc47"
I20250109 21:10:03.762717 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250109 21:10:03.765744 21210 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.766425 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250109 21:10:03.766680 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root
uuid: "f5d1eaae36f84176860e3799d49e4f53"
format_stamp: "Formatted at 2025-01-09 21:10:03 on dist-test-slave-sc47"
I20250109 21:10:03.766973 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:03.781875 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:03.783077 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:03.784632 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:10:03.786710 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:10:03.786906 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.787180 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:10:03.787336 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.847491 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.194:44109
I20250109 21:10:03.847492 21273 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.194:44109 every 8 connection(s)
I20250109 21:10:03.854415 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:03.864156 21278 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:03.865037 21277 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:03.867662 21274 heartbeater.cc:346] Connected to a master server at 127.19.136.254:44891
I20250109 21:10:03.868062 21274 heartbeater.cc:463] Registering TS with master...
I20250109 21:10:03.869028 21274 heartbeater.cc:510] Master 127.19.136.254:44891 requested a full tablet report, sending...
I20250109 21:10:03.869237 20003 server_base.cc:1034] running on GCE node
W20250109 21:10:03.870033 21280 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:03.871210 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:10:03.871488 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:03.871714 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457003871694 us; error 0 us; skew 500 ppm
I20250109 21:10:03.871764 21069 ts_manager.cc:194] Registered new tserver with Master: f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:03.872319 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:03.873550 21069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:60990
I20250109 21:10:03.875392 20003 webserver.cc:458] Webserver started at http://127.19.136.195:33497/ using document root <none> and password file <none>
I20250109 21:10:03.875907 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:03.876116 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:03.876420 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:03.877920 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/instance:
uuid: "0175ef2fbd0349568ba2bf83788476ea"
format_stamp: "Formatted at 2025-01-09 21:10:03 on dist-test-slave-sc47"
I20250109 21:10:03.882611 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.002s
I20250109 21:10:03.885753 21285 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.886474 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250109 21:10:03.886729 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root
uuid: "0175ef2fbd0349568ba2bf83788476ea"
format_stamp: "Formatted at 2025-01-09 21:10:03 on dist-test-slave-sc47"
I20250109 21:10:03.887012 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:03.906213 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:03.907495 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:03.908887 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:10:03.911135 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:10:03.911338 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.911568 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:10:03.911751 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:03.950301 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.195:46241
I20250109 21:10:03.950414 21348 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.195:46241 every 8 connection(s)
I20250109 21:10:03.962834 21349 heartbeater.cc:346] Connected to a master server at 127.19.136.254:44891
I20250109 21:10:03.963225 21349 heartbeater.cc:463] Registering TS with master...
I20250109 21:10:03.964005 21349 heartbeater.cc:510] Master 127.19.136.254:44891 requested a full tablet report, sending...
I20250109 21:10:03.965721 21069 ts_manager.cc:194] Registered new tserver with Master: 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:03.966594 20003 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013364153s
I20250109 21:10:03.966990 21069 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:32768
I20250109 21:10:03.969523 20003 test_util.cc:274] Using random seed: 1726196703
I20250109 21:10:03.991218 21069 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:32780:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250109 21:10:03.997030 21069 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250109 21:10:04.198426 21238 tablet_service.cc:1467] Processing CreateTablet for tablet 261b93a35aef4c86b6bfb6648305855d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250109 21:10:04.199992 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261b93a35aef4c86b6bfb6648305855d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.200947 21237 tablet_service.cc:1467] Processing CreateTablet for tablet 0c81c3f41770456c82eac4f8e6aa7552 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250109 21:10:04.202350 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c81c3f41770456c82eac4f8e6aa7552. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.204178 21236 tablet_service.cc:1467] Processing CreateTablet for tablet 97a78c4d7c18498690c424edd11b94a5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250109 21:10:04.205493 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a78c4d7c18498690c424edd11b94a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.208078 21235 tablet_service.cc:1467] Processing CreateTablet for tablet d399e14db94b4089b4e14d1212dee628 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250109 21:10:04.209352 21235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d399e14db94b4089b4e14d1212dee628. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.211861 21161 tablet_service.cc:1467] Processing CreateTablet for tablet 261b93a35aef4c86b6bfb6648305855d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250109 21:10:04.212169 21234 tablet_service.cc:1467] Processing CreateTablet for tablet 35869458d4934257a5392c4158bc4cd1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250109 21:10:04.213212 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261b93a35aef4c86b6bfb6648305855d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.213464 21234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35869458d4934257a5392c4158bc4cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.216122 21233 tablet_service.cc:1467] Processing CreateTablet for tablet c77aca60924f40f68ecc7531984ef0cc (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250109 21:10:04.217422 21158 tablet_service.cc:1467] Processing CreateTablet for tablet d399e14db94b4089b4e14d1212dee628 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250109 21:10:04.217624 21232 tablet_service.cc:1467] Processing CreateTablet for tablet f660a562716e4048a180570218fae1d4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250109 21:10:04.218683 21158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d399e14db94b4089b4e14d1212dee628. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.219926 21230 tablet_service.cc:1467] Processing CreateTablet for tablet a619c9914d0d497ab180faa27e65a541 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250109 21:10:04.220079 21157 tablet_service.cc:1467] Processing CreateTablet for tablet 35869458d4934257a5392c4158bc4cd1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250109 21:10:04.219942 21231 tablet_service.cc:1467] Processing CreateTablet for tablet 4271f4a728084e65b74f13aa9fa0c6c0 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250109 21:10:04.218024 21233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77aca60924f40f68ecc7531984ef0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.236431 21157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35869458d4934257a5392c4158bc4cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.221968 21156 tablet_service.cc:1467] Processing CreateTablet for tablet c77aca60924f40f68ecc7531984ef0cc (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250109 21:10:04.239432 21230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a619c9914d0d497ab180faa27e65a541. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.239692 21156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77aca60924f40f68ecc7531984ef0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.240501 21236 tablet_service.cc:1467] Processing CreateTablet for tablet 4d0bc120aef54405ad4ea7aee525a029 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250109 21:10:04.241734 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0bc120aef54405ad4ea7aee525a029. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.222187 21229 tablet_service.cc:1467] Processing CreateTablet for tablet 07149574483a42e6849046b112072921 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250109 21:10:04.223779 21155 tablet_service.cc:1467] Processing CreateTablet for tablet f660a562716e4048a180570218fae1d4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250109 21:10:04.243714 21229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07149574483a42e6849046b112072921. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.243851 21155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f660a562716e4048a180570218fae1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.228122 21154 tablet_service.cc:1467] Processing CreateTablet for tablet 4271f4a728084e65b74f13aa9fa0c6c0 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250109 21:10:04.247676 21231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4271f4a728084e65b74f13aa9fa0c6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.247861 21154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4271f4a728084e65b74f13aa9fa0c6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.231027 21153 tablet_service.cc:1467] Processing CreateTablet for tablet a619c9914d0d497ab180faa27e65a541 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250109 21:10:04.251251 21232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f660a562716e4048a180570218fae1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.232162 21159 tablet_service.cc:1467] Processing CreateTablet for tablet 97a78c4d7c18498690c424edd11b94a5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250109 21:10:04.216178 21160 tablet_service.cc:1467] Processing CreateTablet for tablet 0c81c3f41770456c82eac4f8e6aa7552 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250109 21:10:04.255169 21153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a619c9914d0d497ab180faa27e65a541. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.256143 21314 tablet_service.cc:1467] Processing CreateTablet for tablet 261b93a35aef4c86b6bfb6648305855d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250109 21:10:04.257440 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261b93a35aef4c86b6bfb6648305855d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.259579 21160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c81c3f41770456c82eac4f8e6aa7552. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.260133 21313 tablet_service.cc:1467] Processing CreateTablet for tablet 0c81c3f41770456c82eac4f8e6aa7552 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250109 21:10:04.260955 21159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a78c4d7c18498690c424edd11b94a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.261407 21313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c81c3f41770456c82eac4f8e6aa7552. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.264358 21310 tablet_service.cc:1467] Processing CreateTablet for tablet 35869458d4934257a5392c4158bc4cd1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250109 21:10:04.272456 21311 tablet_service.cc:1467] Processing CreateTablet for tablet d399e14db94b4089b4e14d1212dee628 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250109 21:10:04.273814 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d399e14db94b4089b4e14d1212dee628. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.273496 21309 tablet_service.cc:1467] Processing CreateTablet for tablet c77aca60924f40f68ecc7531984ef0cc (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250109 21:10:04.274713 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77aca60924f40f68ecc7531984ef0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.275902 21312 tablet_service.cc:1467] Processing CreateTablet for tablet 97a78c4d7c18498690c424edd11b94a5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250109 21:10:04.277572 21308 tablet_service.cc:1467] Processing CreateTablet for tablet f660a562716e4048a180570218fae1d4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250109 21:10:04.280036 21306 tablet_service.cc:1467] Processing CreateTablet for tablet a619c9914d0d497ab180faa27e65a541 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250109 21:10:04.281314 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a619c9914d0d497ab180faa27e65a541. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.284162 21307 tablet_service.cc:1467] Processing CreateTablet for tablet 4271f4a728084e65b74f13aa9fa0c6c0 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250109 21:10:04.285364 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4271f4a728084e65b74f13aa9fa0c6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.285095 21237 tablet_service.cc:1467] Processing CreateTablet for tablet 703480173d7142d0b22a2ec903e1707d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250109 21:10:04.286271 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703480173d7142d0b22a2ec903e1707d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.287262 21312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a78c4d7c18498690c424edd11b94a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.288758 21305 tablet_service.cc:1467] Processing CreateTablet for tablet 07149574483a42e6849046b112072921 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250109 21:10:04.290037 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07149574483a42e6849046b112072921. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.295207 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f660a562716e4048a180570218fae1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.299330 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35869458d4934257a5392c4158bc4cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.300274 21152 tablet_service.cc:1467] Processing CreateTablet for tablet 07149574483a42e6849046b112072921 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250109 21:10:04.301579 21152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07149574483a42e6849046b112072921. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.315354 21156 tablet_service.cc:1467] Processing CreateTablet for tablet 4d0bc120aef54405ad4ea7aee525a029 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250109 21:10:04.316577 21156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0bc120aef54405ad4ea7aee525a029. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.320389 21237 tablet_service.cc:1467] Processing CreateTablet for tablet 79be174d43c746b8bb3e3f401cef0c4f (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250109 21:10:04.321586 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79be174d43c746b8bb3e3f401cef0c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.333621 21159 tablet_service.cc:1467] Processing CreateTablet for tablet 703480173d7142d0b22a2ec903e1707d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250109 21:10:04.334882 21159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703480173d7142d0b22a2ec903e1707d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.393276 21156 tablet_service.cc:1467] Processing CreateTablet for tablet 79be174d43c746b8bb3e3f401cef0c4f (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250109 21:10:04.406461 21312 tablet_service.cc:1467] Processing CreateTablet for tablet 703480173d7142d0b22a2ec903e1707d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250109 21:10:04.413633 21312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703480173d7142d0b22a2ec903e1707d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.417022 21156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79be174d43c746b8bb3e3f401cef0c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.424717 21366 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:04.424928 21309 tablet_service.cc:1467] Processing CreateTablet for tablet 800dbae8cc64427c8e80cc1ac7b42769 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250109 21:10:04.426290 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 800dbae8cc64427c8e80cc1ac7b42769. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.426941 21306 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7c70db395b4c95bdd3a519fbff09f1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250109 21:10:04.428205 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7c70db395b4c95bdd3a519fbff09f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.433043 21161 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7c70db395b4c95bdd3a519fbff09f1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250109 21:10:04.435859 21157 tablet_service.cc:1467] Processing CreateTablet for tablet 16dee0cc12b842ec877d167505529061 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250109 21:10:04.439383 21229 tablet_service.cc:1467] Processing CreateTablet for tablet 16dee0cc12b842ec877d167505529061 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250109 21:10:04.440622 21229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16dee0cc12b842ec877d167505529061. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.442610 21306 tablet_service.cc:1467] Processing CreateTablet for tablet 16dee0cc12b842ec877d167505529061 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250109 21:10:04.443841 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16dee0cc12b842ec877d167505529061. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.443955 21314 tablet_service.cc:1467] Processing CreateTablet for tablet bba485e8800045ec8e33924e02890beb (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250109 21:10:04.445175 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba485e8800045ec8e33924e02890beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.445555 21231 tablet_service.cc:1467] Processing CreateTablet for tablet bba485e8800045ec8e33924e02890beb (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250109 21:10:04.446687 21231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba485e8800045ec8e33924e02890beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.447089 21237 tablet_service.cc:1467] Processing CreateTablet for tablet 800dbae8cc64427c8e80cc1ac7b42769 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250109 21:10:04.456959 21235 tablet_service.cc:1467] Processing CreateTablet for tablet c404ac7e616f4de9b6df5a2d9259a4b6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250109 21:10:04.458492 21306 tablet_service.cc:1467] Processing CreateTablet for tablet c404ac7e616f4de9b6df5a2d9259a4b6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250109 21:10:04.459640 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c404ac7e616f4de9b6df5a2d9259a4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.458557 21160 tablet_service.cc:1467] Processing CreateTablet for tablet bba485e8800045ec8e33924e02890beb (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250109 21:10:04.465619 21364 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:04.467022 21232 tablet_service.cc:1467] Processing CreateTablet for tablet 6f7c70db395b4c95bdd3a519fbff09f1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250109 21:10:04.467156 21236 tablet_service.cc:1467] Processing CreateTablet for tablet 1fa09aa7e53c4ba9a22836b10b7a8446 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250109 21:10:04.468744 21238 tablet_service.cc:1467] Processing CreateTablet for tablet 0a65a2d287ce4921be6fe0d816e85fd8 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250109 21:10:04.470216 21365 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:04.468879 21311 tablet_service.cc:1467] Processing CreateTablet for tablet 79be174d43c746b8bb3e3f401cef0c4f (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250109 21:10:04.475755 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79be174d43c746b8bb3e3f401cef0c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.415259 21305 tablet_service.cc:1467] Processing CreateTablet for tablet 4d0bc120aef54405ad4ea7aee525a029 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250109 21:10:04.487605 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7c70db395b4c95bdd3a519fbff09f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.518110 21308 tablet_service.cc:1467] Processing CreateTablet for tablet 3991f36cf1024599a42cd83ea8bbd158 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250109 21:10:04.518718 21157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 16dee0cc12b842ec877d167505529061. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.522455 21158 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb0a4ab14fe49cd9d565ffe64396929 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250109 21:10:04.523566 21160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba485e8800045ec8e33924e02890beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.485090 21366 tablet_bootstrap.cc:654] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:04.492249 21230 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb0a4ab14fe49cd9d565ffe64396929 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250109 21:10:04.497511 21229 tablet_service.cc:1467] Processing CreateTablet for tablet 7a4ca66c3087428aaf05f37bc1ba32ee (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250109 21:10:04.504539 21309 tablet_service.cc:1467] Processing CreateTablet for tablet 5bb0a4ab14fe49cd9d565ffe64396929 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250109 21:10:04.508049 21314 tablet_service.cc:1467] Processing CreateTablet for tablet 7a4ca66c3087428aaf05f37bc1ba32ee (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250109 21:10:04.509027 21233 tablet_service.cc:1467] Processing CreateTablet for tablet b3b31fe68ef047b3b126d525dd19991d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250109 21:10:04.510466 21154 tablet_service.cc:1467] Processing CreateTablet for tablet 800dbae8cc64427c8e80cc1ac7b42769 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250109 21:10:04.500110 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4d0bc120aef54405ad4ea7aee525a029. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.538589 21160 tablet_service.cc:1467] Processing CreateTablet for tablet 7a4ca66c3087428aaf05f37bc1ba32ee (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250109 21:10:04.539201 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4ca66c3087428aaf05f37bc1ba32ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.539886 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3991f36cf1024599a42cd83ea8bbd158. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.540428 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb0a4ab14fe49cd9d565ffe64396929. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.540784 21154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 800dbae8cc64427c8e80cc1ac7b42769. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.543480 21155 tablet_service.cc:1467] Processing CreateTablet for tablet c404ac7e616f4de9b6df5a2d9259a4b6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250109 21:10:04.544651 21155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c404ac7e616f4de9b6df5a2d9259a4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.504890 21307 tablet_service.cc:1467] Processing CreateTablet for tablet 1fa09aa7e53c4ba9a22836b10b7a8446 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250109 21:10:04.555222 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa09aa7e53c4ba9a22836b10b7a8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.559278 21365 tablet_bootstrap.cc:654] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:04.559810 21153 tablet_service.cc:1467] Processing CreateTablet for tablet b3b31fe68ef047b3b126d525dd19991d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250109 21:10:04.559980 21160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4ca66c3087428aaf05f37bc1ba32ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.486865 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a65a2d287ce4921be6fe0d816e85fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.498032 21152 tablet_service.cc:1467] Processing CreateTablet for tablet 0a65a2d287ce4921be6fe0d816e85fd8 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250109 21:10:04.563712 21310 tablet_service.cc:1467] Processing CreateTablet for tablet b3b31fe68ef047b3b126d525dd19991d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250109 21:10:04.563967 21311 tablet_service.cc:1467] Processing CreateTablet for tablet 28f6a07c6bbe4fcbadfe6fe3c94f913a (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250109 21:10:04.564379 21152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a65a2d287ce4921be6fe0d816e85fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.564922 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b31fe68ef047b3b126d525dd19991d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.565483 21233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b31fe68ef047b3b126d525dd19991d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.487946 21306 tablet_service.cc:1467] Processing CreateTablet for tablet 0a65a2d287ce4921be6fe0d816e85fd8 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250109 21:10:04.565932 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f6a07c6bbe4fcbadfe6fe3c94f913a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.517833 21234 tablet_service.cc:1467] Processing CreateTablet for tablet 28f6a07c6bbe4fcbadfe6fe3c94f913a (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250109 21:10:04.568162 21234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f6a07c6bbe4fcbadfe6fe3c94f913a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.571735 21229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4ca66c3087428aaf05f37bc1ba32ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.572011 21158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb0a4ab14fe49cd9d565ffe64396929. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.575192 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a65a2d287ce4921be6fe0d816e85fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.580070 21153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b31fe68ef047b3b126d525dd19991d. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:04.582973 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:04.586001 21366 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:04.586453 21366 ts_tablet_manager.cc:1397] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.162s user 0.000s sys 0.010s
I20250109 21:10:04.514016 21159 tablet_service.cc:1467] Processing CreateTablet for tablet 1fa09aa7e53c4ba9a22836b10b7a8446 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250109 21:10:04.575217 21235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c404ac7e616f4de9b6df5a2d9259a4b6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.598867 21238 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa9778f2eb54207aea2f47f9037b443 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250109 21:10:04.613732 21157 tablet_service.cc:1467] Processing CreateTablet for tablet 8b90fd0d512143d7ba14c703e675aeaf (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250109 21:10:04.618659 21309 tablet_service.cc:1467] Processing CreateTablet for tablet 8b90fd0d512143d7ba14c703e675aeaf (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250109 21:10:04.619881 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b90fd0d512143d7ba14c703e675aeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.623016 21314 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa9778f2eb54207aea2f47f9037b443 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250109 21:10:04.624228 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa9778f2eb54207aea2f47f9037b443. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.626330 21313 tablet_service.cc:1467] Processing CreateTablet for tablet 3370e7f927b540069bc6fe3599a7f555 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250109 21:10:04.628968 21313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3370e7f927b540069bc6fe3599a7f555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.607834 21366 raft_consensus.cc:357] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:04.610337 21159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa09aa7e53c4ba9a22836b10b7a8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.634974 21364 tablet_bootstrap.cc:654] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:04.601215 21161 tablet_service.cc:1467] Processing CreateTablet for tablet 28f6a07c6bbe4fcbadfe6fe3c94f913a (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250109 21:10:04.639680 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 28f6a07c6bbe4fcbadfe6fe3c94f913a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.611063 21230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb0a4ab14fe49cd9d565ffe64396929. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.644301 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa09aa7e53c4ba9a22836b10b7a8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.647231 21232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7c70db395b4c95bdd3a519fbff09f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.648097 21305 tablet_service.cc:1467] Processing CreateTablet for tablet c0107e66d7794efeb3ab5f03388ecae1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250109 21:10:04.649318 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0107e66d7794efeb3ab5f03388ecae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.631879 21366 raft_consensus.cc:383] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:04.651237 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 800dbae8cc64427c8e80cc1ac7b42769. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.651311 21366 raft_consensus.cc:738] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:04.652256 21366 consensus_queue.cc:260] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:04.668709 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa9778f2eb54207aea2f47f9037b443. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.678836 21155 tablet_service.cc:1467] Processing CreateTablet for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250109 21:10:04.683449 21156 tablet_service.cc:1467] Processing CreateTablet for tablet 3370e7f927b540069bc6fe3599a7f555 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250109 21:10:04.685281 21229 tablet_service.cc:1467] Processing CreateTablet for tablet 3370e7f927b540069bc6fe3599a7f555 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250109 21:10:04.686498 21229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3370e7f927b540069bc6fe3599a7f555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.688755 21307 tablet_service.cc:1467] Processing CreateTablet for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250109 21:10:04.662999 21157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b90fd0d512143d7ba14c703e675aeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.641827 21231 tablet_service.cc:1467] Processing CreateTablet for tablet 8b90fd0d512143d7ba14c703e675aeaf (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250109 21:10:04.690686 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.612010 21152 tablet_service.cc:1467] Processing CreateTablet for tablet 9fa9778f2eb54207aea2f47f9037b443 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250109 21:10:04.696161 21366 ts_tablet_manager.cc:1428] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.109s user 0.002s sys 0.009s
I20250109 21:10:04.700392 21231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b90fd0d512143d7ba14c703e675aeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.702840 21349 heartbeater.cc:502] Master 127.19.136.254:44891 was elected leader, sending a full tablet report...
I20250109 21:10:04.703078 21366 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
W20250109 21:10:04.704442 21350 tablet.cc:2367] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250109 21:10:04.705600 21365 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:04.706032 21365 ts_tablet_manager.cc:1397] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.236s user 0.018s sys 0.000s
I20250109 21:10:04.717355 21155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.718603 21156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3370e7f927b540069bc6fe3599a7f555. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.718514 21160 tablet_service.cc:1467] Processing CreateTablet for tablet c0107e66d7794efeb3ab5f03388ecae1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250109 21:10:04.718696 21154 tablet_service.cc:1467] Processing CreateTablet for tablet fc2136d77ff941c8aee442e2c39c95bb (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250109 21:10:04.690718 21312 tablet_service.cc:1467] Processing CreateTablet for tablet 44dc7037c0cc4926b2e36fab2a05a11a (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250109 21:10:04.715970 21153 tablet_service.cc:1467] Processing CreateTablet for tablet 3991f36cf1024599a42cd83ea8bbd158 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250109 21:10:04.729204 21364 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:04.729664 21364 ts_tablet_manager.cc:1397] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.264s user 0.013s sys 0.018s
I20250109 21:10:04.732363 21364 raft_consensus.cc:357] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:04.733112 21364 raft_consensus.cc:383] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:04.733399 21364 raft_consensus.cc:738] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:04.733917 21312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dc7037c0cc4926b2e36fab2a05a11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.739449 21152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa9778f2eb54207aea2f47f9037b443. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.693440 21311 tablet_service.cc:1467] Processing CreateTablet for tablet fc2136d77ff941c8aee442e2c39c95bb (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250109 21:10:04.743250 21160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0107e66d7794efeb3ab5f03388ecae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.743834 21154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2136d77ff941c8aee442e2c39c95bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.744032 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2136d77ff941c8aee442e2c39c95bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.744678 21236 tablet_service.cc:1467] Processing CreateTablet for tablet 3991f36cf1024599a42cd83ea8bbd158 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250109 21:10:04.734290 21364 consensus_queue.cc:260] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:04.752665 21153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3991f36cf1024599a42cd83ea8bbd158. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.751237 21308 tablet_service.cc:1467] Processing CreateTablet for tablet c714104a3f784fa2a8dbab3a26b67e16 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250109 21:10:04.753722 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c714104a3f784fa2a8dbab3a26b67e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.756652 21306 tablet_service.cc:1467] Processing CreateTablet for tablet 41937a55ec6c4990b362365d82685977 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250109 21:10:04.760428 21197 heartbeater.cc:502] Master 127.19.136.254:44891 was elected leader, sending a full tablet report...
I20250109 21:10:04.752529 21310 tablet_service.cc:1467] Processing CreateTablet for tablet 61283e0a72e04a589880431a717f04f3 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250109 21:10:04.760404 21365 raft_consensus.cc:357] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:04.761005 21233 tablet_service.cc:1467] Processing CreateTablet for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250109 21:10:04.771399 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3991f36cf1024599a42cd83ea8bbd158. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.772189 21159 tablet_service.cc:1467] Processing CreateTablet for tablet 41937a55ec6c4990b362365d82685977 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250109 21:10:04.779812 21159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41937a55ec6c4990b362365d82685977. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.782104 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61283e0a72e04a589880431a717f04f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.782723 21233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.776283 21307 tablet_service.cc:1467] Processing CreateTablet for tablet 7e21bd94dd8648d09b26343df6230d65 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250109 21:10:04.783747 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e21bd94dd8648d09b26343df6230d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.787424 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41937a55ec6c4990b362365d82685977. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.691867 21158 tablet_service.cc:1467] Processing CreateTablet for tablet 44dc7037c0cc4926b2e36fab2a05a11a (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250109 21:10:04.791697 21158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dc7037c0cc4926b2e36fab2a05a11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.794986 21365 raft_consensus.cc:383] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:04.795336 21365 raft_consensus.cc:738] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:04.796136 21365 consensus_queue.cc:260] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:04.804747 21161 tablet_service.cc:1467] Processing CreateTablet for tablet 61283e0a72e04a589880431a717f04f3 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250109 21:10:04.806021 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61283e0a72e04a589880431a717f04f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.798489 21160 tablet_service.cc:1467] Processing CreateTablet for tablet c714104a3f784fa2a8dbab3a26b67e16 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250109 21:10:04.807704 21160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c714104a3f784fa2a8dbab3a26b67e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.812003 21237 tablet_service.cc:1467] Processing CreateTablet for tablet 44dc7037c0cc4926b2e36fab2a05a11a (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250109 21:10:04.812436 21314 tablet_service.cc:1467] Processing CreateTablet for tablet 625c888e7e504f50aec0019c1947cce5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250109 21:10:04.813230 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dc7037c0cc4926b2e36fab2a05a11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.813576 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625c888e7e504f50aec0019c1947cce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.819816 21232 tablet_service.cc:1467] Processing CreateTablet for tablet fc2136d77ff941c8aee442e2c39c95bb (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250109 21:10:04.821029 21232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fc2136d77ff941c8aee442e2c39c95bb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.766574 21234 tablet_service.cc:1467] Processing CreateTablet for tablet c0107e66d7794efeb3ab5f03388ecae1 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250109 21:10:04.830765 21274 heartbeater.cc:502] Master 127.19.136.254:44891 was elected leader, sending a full tablet report...
I20250109 21:10:04.844417 21311 tablet_service.cc:1467] Processing CreateTablet for tablet 73f91268c8384e79a83979ffd1c00d99 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250109 21:10:04.845671 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f91268c8384e79a83979ffd1c00d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.836972 21154 tablet_service.cc:1467] Processing CreateTablet for tablet 7e21bd94dd8648d09b26343df6230d65 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250109 21:10:04.854655 21364 ts_tablet_manager.cc:1428] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.125s user 0.007s sys 0.008s
I20250109 21:10:04.859298 21311 tablet_service.cc:1467] Processing CreateTablet for tablet 909c8965e81d4f84a75ef2fd61bcbe72 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250109 21:10:04.860415 21311 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 909c8965e81d4f84a75ef2fd61bcbe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.861003 21155 tablet_service.cc:1467] Processing CreateTablet for tablet 625c888e7e504f50aec0019c1947cce5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250109 21:10:04.867820 21156 tablet_service.cc:1467] Processing CreateTablet for tablet 8bfae02cdbdc49daa617467659ffaed6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250109 21:10:04.877975 21313 tablet_service.cc:1467] Processing CreateTablet for tablet 8bfae02cdbdc49daa617467659ffaed6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250109 21:10:04.896025 21312 tablet_service.cc:1467] Processing CreateTablet for tablet f8d059ec48cb46dfac04405794b984ee (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250109 21:10:04.897543 21305 tablet_service.cc:1467] Processing CreateTablet for tablet 2963062e448e46b3b27c83dd6c77b956 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250109 21:10:04.907414 21366 tablet_bootstrap.cc:654] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:04.908003 21365 ts_tablet_manager.cc:1428] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.202s user 0.012s sys 0.009s
I20250109 21:10:04.919467 21156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bfae02cdbdc49daa617467659ffaed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.920073 21155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625c888e7e504f50aec0019c1947cce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.923194 21154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e21bd94dd8648d09b26343df6230d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.925010 21230 tablet_service.cc:1467] Processing CreateTablet for tablet 41937a55ec6c4990b362365d82685977 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250109 21:10:04.926220 21230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 41937a55ec6c4990b362365d82685977. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.927634 21364 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:04.930266 21238 tablet_service.cc:1467] Processing CreateTablet for tablet c714104a3f784fa2a8dbab3a26b67e16 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250109 21:10:04.937129 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c714104a3f784fa2a8dbab3a26b67e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.932196 21237 tablet_service.cc:1467] Processing CreateTablet for tablet 61283e0a72e04a589880431a717f04f3 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250109 21:10:04.939491 21310 tablet_service.cc:1467] Processing CreateTablet for tablet f8fab7dbf6344706915ff7ec21cc5430 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250109 21:10:04.939188 21314 tablet_service.cc:1467] Processing CreateTablet for tablet 9add3f091006404a8cbf90aef76b0c5d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250109 21:10:04.935945 21229 tablet_service.cc:1467] Processing CreateTablet for tablet 7e21bd94dd8648d09b26343df6230d65 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250109 21:10:04.939934 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61283e0a72e04a589880431a717f04f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.940421 21152 tablet_service.cc:1467] Processing CreateTablet for tablet 2963062e448e46b3b27c83dd6c77b956 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250109 21:10:04.941561 21152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2963062e448e46b3b27c83dd6c77b956. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.938347 21231 tablet_service.cc:1467] Processing CreateTablet for tablet 625c888e7e504f50aec0019c1947cce5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250109 21:10:04.942108 21309 tablet_service.cc:1467] Processing CreateTablet for tablet e719827258244d4c9a82be8775a044f5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250109 21:10:04.944234 21159 tablet_service.cc:1467] Processing CreateTablet for tablet f8d059ec48cb46dfac04405794b984ee (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250109 21:10:04.945564 21159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d059ec48cb46dfac04405794b984ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.952899 21157 tablet_service.cc:1467] Processing CreateTablet for tablet 909c8965e81d4f84a75ef2fd61bcbe72 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250109 21:10:04.958487 21160 tablet_service.cc:1467] Processing CreateTablet for tablet 73f91268c8384e79a83979ffd1c00d99 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250109 21:10:04.973225 21157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 909c8965e81d4f84a75ef2fd61bcbe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.975569 21366 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:04.976043 21366 ts_tablet_manager.cc:1397] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.273s user 0.013s sys 0.000s
I20250109 21:10:04.978458 21160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f91268c8384e79a83979ffd1c00d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.980051 21366 raft_consensus.cc:357] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:04.965340 21364 tablet_bootstrap.cc:654] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:04.980796 21366 raft_consensus.cc:383] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:04.966251 21158 tablet_service.cc:1467] Processing CreateTablet for tablet 9add3f091006404a8cbf90aef76b0c5d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250109 21:10:04.981142 21366 raft_consensus.cc:738] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:04.981891 21158 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9add3f091006404a8cbf90aef76b0c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.981997 21366 consensus_queue.cc:260] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:04.983501 21370 raft_consensus.cc:491] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:04.983983 21370 raft_consensus.cc:513] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:04.986316 21370 leader_election.cc:290] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:04.971357 21365 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:04.971864 21229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e21bd94dd8648d09b26343df6230d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.931512 21313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bfae02cdbdc49daa617467659ffaed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.992504 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e719827258244d4c9a82be8775a044f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.991693 21234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0107e66d7794efeb3ab5f03388ecae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.995210 21312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d059ec48cb46dfac04405794b984ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.999200 21231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 625c888e7e504f50aec0019c1947cce5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:04.998962 21161 tablet_service.cc:1467] Processing CreateTablet for tablet f8fab7dbf6344706915ff7ec21cc5430 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250109 21:10:05.000245 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fab7dbf6344706915ff7ec21cc5430. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.009219 21366 ts_tablet_manager.cc:1428] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.033s user 0.007s sys 0.000s
I20250109 21:10:05.010118 21366 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:04.999285 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9add3f091006404a8cbf90aef76b0c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.014597 21372 raft_consensus.cc:491] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.015058 21372 raft_consensus.cc:513] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.017982 21371 raft_consensus.cc:491] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.019773 21371 raft_consensus.cc:513] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:05.004923 21153 tablet_service.cc:1467] Processing CreateTablet for tablet e719827258244d4c9a82be8775a044f5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250109 21:10:05.023156 21232 tablet_service.cc:1467] Processing CreateTablet for tablet 2963062e448e46b3b27c83dd6c77b956 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250109 21:10:05.023576 21371 leader_election.cc:290] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241), 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:05.021118 21306 tablet_service.cc:1467] Processing CreateTablet for tablet b45a48f8e1e34fba9a5089b31d8966e7 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250109 21:10:05.032599 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fab7dbf6344706915ff7ec21cc5430. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.041399 21365 tablet_bootstrap.cc:654] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.059139 21232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2963062e448e46b3b27c83dd6c77b956. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.066833 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45a48f8e1e34fba9a5089b31d8966e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.026515 21155 tablet_service.cc:1467] Processing CreateTablet for tablet b45a48f8e1e34fba9a5089b31d8966e7 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250109 21:10:05.041859 21372 leader_election.cc:290] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.065292 21153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e719827258244d4c9a82be8775a044f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.052363 21156 tablet_service.cc:1467] Processing CreateTablet for tablet c941548822ea4678abcf5c764a2d24a4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250109 21:10:05.094295 21155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45a48f8e1e34fba9a5089b31d8966e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.095254 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2963062e448e46b3b27c83dd6c77b956. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.134554 21156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c941548822ea4678abcf5c764a2d24a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.091702 21235 tablet_service.cc:1467] Processing CreateTablet for tablet 8bfae02cdbdc49daa617467659ffaed6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250109 21:10:05.111325 21307 tablet_service.cc:1467] Processing CreateTablet for tablet c941548822ea4678abcf5c764a2d24a4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250109 21:10:05.140031 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c941548822ea4678abcf5c764a2d24a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.156333 21364 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.156854 21364 ts_tablet_manager.cc:1397] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.229s user 0.010s sys 0.009s
I20250109 21:10:05.091434 21308 tablet_service.cc:1467] Processing CreateTablet for tablet abb16506c36a4e58a36455d201947d07 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250109 21:10:05.159662 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb16506c36a4e58a36455d201947d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.176827 21233 tablet_service.cc:1467] Processing CreateTablet for tablet 73f91268c8384e79a83979ffd1c00d99 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250109 21:10:05.115473 21154 tablet_service.cc:1467] Processing CreateTablet for tablet abb16506c36a4e58a36455d201947d07 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250109 21:10:05.187816 21364 raft_consensus.cc:357] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.188632 21364 raft_consensus.cc:383] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.190084 21364 raft_consensus.cc:738] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.190475 21154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb16506c36a4e58a36455d201947d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.190778 21364 consensus_queue.cc:260] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.193161 21364 ts_tablet_manager.cc:1428] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.036s user 0.007s sys 0.000s
I20250109 21:10:05.218626 21233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f91268c8384e79a83979ffd1c00d99. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:05.228329 21056 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 106798us
I20250109 21:10:05.228859 21235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8bfae02cdbdc49daa617467659ffaed6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.233237 21370 raft_consensus.cc:491] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.236581 21370 raft_consensus.cc:513] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.237619 21236 tablet_service.cc:1467] Processing CreateTablet for tablet f8d059ec48cb46dfac04405794b984ee (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250109 21:10:05.239933 21308 tablet_service.cc:1467] Processing CreateTablet for tablet 8a822be40fe74d1a8c6ab5aec62bcb14 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250109 21:10:05.240599 21370 leader_election.cc:290] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:05.241115 21308 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a822be40fe74d1a8c6ab5aec62bcb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.242902 21237 tablet_service.cc:1467] Processing CreateTablet for tablet 909c8965e81d4f84a75ef2fd61bcbe72 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250109 21:10:05.252406 21313 tablet_service.cc:1467] Processing CreateTablet for tablet ec98ab18b5ba44949aeef1a8a519bb67 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250109 21:10:05.253720 21313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec98ab18b5ba44949aeef1a8a519bb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.255822 21364 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.258052 21160 tablet_service.cc:1467] Processing CreateTablet for tablet b4695aea7c274b7e830e07c2fdbb1dc6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250109 21:10:05.259810 21160 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4695aea7c274b7e830e07c2fdbb1dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.268437 21229 tablet_service.cc:1467] Processing CreateTablet for tablet 9add3f091006404a8cbf90aef76b0c5d (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250109 21:10:05.238790 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d059ec48cb46dfac04405794b984ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.274012 21306 tablet_service.cc:1467] Processing CreateTablet for tablet 2f76b5c3db5e4c1885ce16d810372999 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250109 21:10:05.274012 21310 tablet_service.cc:1467] Processing CreateTablet for tablet b4695aea7c274b7e830e07c2fdbb1dc6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250109 21:10:05.281365 21152 tablet_service.cc:1467] Processing CreateTablet for tablet ec98ab18b5ba44949aeef1a8a519bb67 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250109 21:10:05.287673 21152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec98ab18b5ba44949aeef1a8a519bb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.288276 21159 tablet_service.cc:1467] Processing CreateTablet for tablet 2f76b5c3db5e4c1885ce16d810372999 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250109 21:10:05.289510 21159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f76b5c3db5e4c1885ce16d810372999. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.296885 21157 tablet_service.cc:1467] Processing CreateTablet for tablet 8a822be40fe74d1a8c6ab5aec62bcb14 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250109 21:10:05.298090 21157 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a822be40fe74d1a8c6ab5aec62bcb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.286283 21366 tablet_bootstrap.cc:654] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.286342 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f76b5c3db5e4c1885ce16d810372999. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.306447 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.311918 21161 tablet_service.cc:1467] Processing CreateTablet for tablet 4a96090bb1b54bf1b35f150050e71ee7 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250109 21:10:05.316147 21310 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4695aea7c274b7e830e07c2fdbb1dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.323086 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 909c8965e81d4f84a75ef2fd61bcbe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.328014 21314 tablet_service.cc:1467] Processing CreateTablet for tablet 897320ddfb174b3c9c5751844ec65430 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250109 21:10:05.329661 21314 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897320ddfb174b3c9c5751844ec65430. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.331831 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35869458d4934257a5392c4158bc4cd1" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:05.335440 21214 leader_election.cc:343] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:05.335476 21136 leader_election.cc:343] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.339318 21159 tablet_service.cc:1467] Processing CreateTablet for tablet 897320ddfb174b3c9c5751844ec65430 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250109 21:10:05.340934 21159 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897320ddfb174b3c9c5751844ec65430. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.349189 21312 tablet_service.cc:1467] Processing CreateTablet for tablet 4a96090bb1b54bf1b35f150050e71ee7 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250109 21:10:05.349731 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:05.351080 21312 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a96090bb1b54bf1b35f150050e71ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.351676 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:05.363516 21161 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a96090bb1b54bf1b35f150050e71ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.365365 21153 tablet_service.cc:1467] Processing CreateTablet for tablet b920d950f0d3444d9fff00a1bad09dc6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250109 21:10:05.366603 21153 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b920d950f0d3444d9fff00a1bad09dc6. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:05.352651 21288 leader_election.cc:343] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.353940 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.355201 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.374845 21365 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.375319 21365 ts_tablet_manager.cc:1397] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.404s user 0.019s sys 0.046s
I20250109 21:10:05.362308 21309 tablet_service.cc:1467] Processing CreateTablet for tablet b920d950f0d3444d9fff00a1bad09dc6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250109 21:10:05.376302 21309 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b920d950f0d3444d9fff00a1bad09dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.369403 21231 tablet_service.cc:1467] Processing CreateTablet for tablet e719827258244d4c9a82be8775a044f5 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250109 21:10:05.351935 21238 tablet_service.cc:1467] Processing CreateTablet for tablet f8fab7dbf6344706915ff7ec21cc5430 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250109 21:10:05.372886 21235 tablet_service.cc:1467] Processing CreateTablet for tablet b45a48f8e1e34fba9a5089b31d8966e7 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250109 21:10:05.377966 21365 raft_consensus.cc:357] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.378693 21365 raft_consensus.cc:383] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250109 21:10:05.374428 21288 leader_election.cc:343] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.373602 21155 tablet_service.cc:1467] Processing CreateTablet for tablet fbf52261cbf144de9a86b9f32c5ed7f0 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250109 21:10:05.391805 21234 rpcz_store.cc:275] Call kudu.tserver.TabletServerAdminService.CreateTablet from 127.0.0.1:57544 (request call id 29) took 1013 ms. Trace:
I20250109 21:10:05.392333 21155 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf52261cbf144de9a86b9f32c5ed7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.392215 21234 rpcz_store.cc:276] 0109 21:10:04.378086 (+ 0us) service_pool.cc:168] Inserting onto call queue
0109 21:10:04.765717 (+387631us) service_pool.cc:225] Handling call
0109 21:10:04.841603 (+ 75886us) ts_tablet_manager.cc:663] Acquired tablet manager lock
0109 21:10:04.943871 (+102268us) ts_tablet_manager.cc:676] Creating new metadata...
0109 21:10:05.208507 (+264636us) tablet_metadata.cc:641] Metadata flushed
0109 21:10:05.305312 (+ 96805us) tablet_replica.cc:206] Creating consensus instance
0109 21:10:05.391734 (+ 86422us) inbound_call.cc:173] Queueing success response
Metrics: {}
I20250109 21:10:05.397508 21232 tablet_service.cc:1467] Processing CreateTablet for tablet ec98ab18b5ba44949aeef1a8a519bb67 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250109 21:10:05.383888 21365 raft_consensus.cc:738] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
W20250109 21:10:05.384284 21288 leader_election.cc:343] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.400117 21288 leader_election.cc:304] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:05.387727 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.401332 21370 raft_consensus.cc:2743] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:05.401419 21288 leader_election.cc:343] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.388274 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35869458d4934257a5392c4158bc4cd1" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.403190 21365 consensus_queue.cc:260] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:05.404400 21213 leader_election.cc:343] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.405141 21213 leader_election.cc:304] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:05.387639 21229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9add3f091006404a8cbf90aef76b0c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.406635 21371 raft_consensus.cc:2743] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:05.407279 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fab7dbf6344706915ff7ec21cc5430. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.389029 21230 tablet_service.cc:1467] Processing CreateTablet for tablet c941548822ea4678abcf5c764a2d24a4 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250109 21:10:05.408568 21230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c941548822ea4678abcf5c764a2d24a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.409089 21231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e719827258244d4c9a82be8775a044f5. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:05.403707 21137 leader_election.cc:343] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.409621 21137 leader_election.cc:304] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:05.410400 21372 raft_consensus.cc:2743] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:05.410490 21235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45a48f8e1e34fba9a5089b31d8966e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.401988 21288 leader_election.cc:304] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:05.413487 21370 raft_consensus.cc:2743] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:05.415743 21234 tablet_service.cc:1467] Processing CreateTablet for tablet 8a822be40fe74d1a8c6ab5aec62bcb14 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250109 21:10:05.417115 21234 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a822be40fe74d1a8c6ab5aec62bcb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.422261 21313 tablet_service.cc:1467] Processing CreateTablet for tablet fbf52261cbf144de9a86b9f32c5ed7f0 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250109 21:10:05.423838 21313 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf52261cbf144de9a86b9f32c5ed7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.394662 21236 tablet_service.cc:1467] Processing CreateTablet for tablet abb16506c36a4e58a36455d201947d07 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250109 21:10:05.440270 21232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec98ab18b5ba44949aeef1a8a519bb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.441637 21366 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.442133 21366 ts_tablet_manager.cc:1397] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.432s user 0.011s sys 0.007s
I20250109 21:10:05.443174 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb16506c36a4e58a36455d201947d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.445557 21154 tablet_service.cc:1467] Processing CreateTablet for tablet 65dabcea5fff4017b727f2fcdee56246 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250109 21:10:05.451195 21305 tablet_service.cc:1467] Processing CreateTablet for tablet f75eb10b9fad472794f2398d9f305706 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250109 21:10:05.452418 21305 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75eb10b9fad472794f2398d9f305706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.451567 21365 ts_tablet_manager.cc:1428] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.076s user 0.009s sys 0.000s
I20250109 21:10:05.456270 21156 tablet_service.cc:1467] Processing CreateTablet for tablet f75eb10b9fad472794f2398d9f305706 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250109 21:10:05.457662 21307 tablet_service.cc:1467] Processing CreateTablet for tablet 65dabcea5fff4017b727f2fcdee56246 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250109 21:10:05.459973 21365 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.436515 21364 tablet_bootstrap.cc:654] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.446820 21154 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dabcea5fff4017b727f2fcdee56246. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.465194 21156 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75eb10b9fad472794f2398d9f305706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.481626 21307 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dabcea5fff4017b727f2fcdee56246. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.470616 21366 raft_consensus.cc:357] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.495028 21366 raft_consensus.cc:383] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.495352 21366 raft_consensus.cc:738] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.497110 21237 tablet_service.cc:1467] Processing CreateTablet for tablet b4695aea7c274b7e830e07c2fdbb1dc6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250109 21:10:05.499099 21233 tablet_service.cc:1467] Processing CreateTablet for tablet 2f76b5c3db5e4c1885ce16d810372999 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250109 21:10:05.500300 21152 tablet_service.cc:1467] Processing CreateTablet for tablet 33a9dea3cbbb40abbdf4eb26e597f857 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250109 21:10:05.500844 21366 consensus_queue.cc:260] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.501116 21306 tablet_service.cc:1467] Processing CreateTablet for tablet 33a9dea3cbbb40abbdf4eb26e597f857 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250109 21:10:05.502399 21306 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a9dea3cbbb40abbdf4eb26e597f857. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.508174 21230 tablet_service.cc:1467] Processing CreateTablet for tablet 4a96090bb1b54bf1b35f150050e71ee7 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250109 21:10:05.514564 21366 ts_tablet_manager.cc:1428] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.072s user 0.005s sys 0.003s
I20250109 21:10:05.501559 21152 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a9dea3cbbb40abbdf4eb26e597f857. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.500357 21233 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2f76b5c3db5e4c1885ce16d810372999. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.520774 21364 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.530612 21364 ts_tablet_manager.cc:1397] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.275s user 0.009s sys 0.015s
I20250109 21:10:05.533315 21364 raft_consensus.cc:357] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.534044 21364 raft_consensus.cc:383] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.534332 21364 raft_consensus.cc:738] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.534663 21236 tablet_service.cc:1467] Processing CreateTablet for tablet f75eb10b9fad472794f2398d9f305706 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250109 21:10:05.536096 21230 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a96090bb1b54bf1b35f150050e71ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.536746 21237 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b4695aea7c274b7e830e07c2fdbb1dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.543203 21364 consensus_queue.cc:260] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.545583 21364 ts_tablet_manager.cc:1428] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20250109 21:10:05.524194 21365 tablet_bootstrap.cc:654] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.527565 21238 tablet_service.cc:1467] Processing CreateTablet for tablet fbf52261cbf144de9a86b9f32c5ed7f0 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250109 21:10:05.551793 21231 tablet_service.cc:1467] Processing CreateTablet for tablet b920d950f0d3444d9fff00a1bad09dc6 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250109 21:10:05.516819 21232 tablet_service.cc:1467] Processing CreateTablet for tablet 897320ddfb174b3c9c5751844ec65430 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250109 21:10:05.529695 21235 tablet_service.cc:1467] Processing CreateTablet for tablet 65dabcea5fff4017b727f2fcdee56246 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250109 21:10:05.554102 21366 tablet_bootstrap.cc:492] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.555212 21236 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75eb10b9fad472794f2398d9f305706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.556607 21229 tablet_service.cc:1467] Processing CreateTablet for tablet 33a9dea3cbbb40abbdf4eb26e597f857 (DEFAULT_TABLE table=test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250109 21:10:05.560405 21364 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.560523 21366 tablet_bootstrap.cc:654] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.563632 21235 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dabcea5fff4017b727f2fcdee56246. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.567615 21238 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf52261cbf144de9a86b9f32c5ed7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.571542 21229 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a9dea3cbbb40abbdf4eb26e597f857. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.578362 21365 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.578933 21365 ts_tablet_manager.cc:1397] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.119s user 0.006s sys 0.010s
I20250109 21:10:05.579586 21232 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 897320ddfb174b3c9c5751844ec65430. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.581533 21231 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b920d950f0d3444d9fff00a1bad09dc6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:05.582101 21365 raft_consensus.cc:357] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.584626 21364 tablet_bootstrap.cc:654] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:05.585228 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:05.586824 21366 tablet_bootstrap.cc:492] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.596752 21366 ts_tablet_manager.cc:1397] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.003s
I20250109 21:10:05.603071 21365 raft_consensus.cc:383] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.603564 21365 raft_consensus.cc:738] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.604580 21365 consensus_queue.cc:260] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.622045 21366 raft_consensus.cc:357] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.622802 21366 raft_consensus.cc:383] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.623643 21372 raft_consensus.cc:491] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.624101 21372 raft_consensus.cc:513] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.625623 21365 ts_tablet_manager.cc:1428] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.046s user 0.010s sys 0.002s
I20250109 21:10:05.626008 21372 leader_election.cc:290] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.626773 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:05.627151 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.627753 21324 raft_consensus.cc:2463] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
W20250109 21:10:05.628093 21136 leader_election.cc:343] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.628532 21364 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.629004 21364 ts_tablet_manager.cc:1397] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.069s user 0.001s sys 0.019s
I20250109 21:10:05.629134 21137 leader_election.cc:304] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:05.629864 21372 raft_consensus.cc:2798] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:05.630213 21372 raft_consensus.cc:491] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:05.630537 21372 raft_consensus.cc:3054] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.623152 21366 raft_consensus.cc:738] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.632807 21366 consensus_queue.cc:260] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.633497 21365 tablet_bootstrap.cc:492] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.636914 21372 raft_consensus.cc:513] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.639472 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:05.639875 21365 tablet_bootstrap.cc:654] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:05.640758 21136 leader_election.cc:343] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.631680 21364 raft_consensus.cc:357] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.641134 21366 ts_tablet_manager.cc:1428] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.044s user 0.009s sys 0.007s
I20250109 21:10:05.641288 21364 raft_consensus.cc:383] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.641603 21364 raft_consensus.cc:738] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.642333 21364 consensus_queue.cc:260] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.643113 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:05.643813 21324 raft_consensus.cc:3054] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.644877 21364 ts_tablet_manager.cc:1428] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20250109 21:10:05.646700 21366 tablet_bootstrap.cc:492] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.652781 21324 raft_consensus.cc:2463] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:05.654048 21364 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.654666 21137 leader_election.cc:304] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:05.653187 21366 tablet_bootstrap.cc:654] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.656893 21394 raft_consensus.cc:2798] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:05.653429 21372 leader_election.cc:290] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.660207 21364 tablet_bootstrap.cc:654] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.660856 21394 raft_consensus.cc:695] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:05.661898 21394 consensus_queue.cc:237] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.663661 21366 tablet_bootstrap.cc:492] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.664121 21366 ts_tablet_manager.cc:1397] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.018s user 0.012s sys 0.000s
I20250109 21:10:05.667340 21366 raft_consensus.cc:357] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.668303 21366 raft_consensus.cc:383] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.668809 21365 tablet_bootstrap.cc:492] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.668762 21366 raft_consensus.cc:738] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.669368 21364 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.669528 21365 ts_tablet_manager.cc:1397] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.036s user 0.013s sys 0.017s
I20250109 21:10:05.669780 21364 ts_tablet_manager.cc:1397] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.016s user 0.011s sys 0.003s
I20250109 21:10:05.669832 21366 consensus_queue.cc:260] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.672364 21365 raft_consensus.cc:357] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.672667 21364 raft_consensus.cc:357] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.673314 21365 raft_consensus.cc:383] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.673472 21364 raft_consensus.cc:383] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.673795 21365 raft_consensus.cc:738] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.673796 21364 raft_consensus.cc:738] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.674957 21365 consensus_queue.cc:260] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.676234 21364 consensus_queue.cc:260] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.677381 21365 ts_tablet_manager.cc:1428] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250109 21:10:05.678314 21365 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.678627 21366 ts_tablet_manager.cc:1428] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.014s user 0.005s sys 0.003s
I20250109 21:10:05.677979 21067 catalog_manager.cc:5526] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:05.679589 21366 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.681756 21364 ts_tablet_manager.cc:1428] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20250109 21:10:05.682734 21364 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.685452 21365 tablet_bootstrap.cc:654] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.687103 21366 tablet_bootstrap.cc:654] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.689437 21364 tablet_bootstrap.cc:654] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.691282 21370 raft_consensus.cc:491] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.691715 21370 raft_consensus.cc:513] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.696095 21370 leader_election.cc:290] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:05.696764 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97a78c4d7c18498690c424edd11b94a5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.697391 21170 raft_consensus.cc:2463] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:05.698511 21288 leader_election.cc:304] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:05.699370 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97a78c4d7c18498690c424edd11b94a5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:05.700192 21248 raft_consensus.cc:2463] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:05.700716 21370 raft_consensus.cc:2798] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:05.701087 21370 raft_consensus.cc:491] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:05.701411 21370 raft_consensus.cc:3054] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.702207 21365 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.702749 21365 ts_tablet_manager.cc:1397] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.003s
I20250109 21:10:05.704528 21366 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.704990 21366 ts_tablet_manager.cc:1397] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.012s
I20250109 21:10:05.706003 21365 raft_consensus.cc:357] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.706899 21365 raft_consensus.cc:383] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.707257 21365 raft_consensus.cc:738] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.707728 21366 raft_consensus.cc:357] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:05.707842 21370 raft_consensus.cc:513] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.708595 21366 raft_consensus.cc:383] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.708945 21366 raft_consensus.cc:738] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.709789 21370 leader_election.cc:290] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:05.710752 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97a78c4d7c18498690c424edd11b94a5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:05.711182 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "97a78c4d7c18498690c424edd11b94a5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:05.711330 21170 raft_consensus.cc:3054] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.711730 21248 raft_consensus.cc:3054] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.714980 21365 consensus_queue.cc:260] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.716602 21364 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.717023 21364 ts_tablet_manager.cc:1397] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.034s user 0.006s sys 0.013s
I20250109 21:10:05.717559 21365 ts_tablet_manager.cc:1428] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20250109 21:10:05.717864 21170 raft_consensus.cc:2463] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:05.718463 21365 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.718885 21288 leader_election.cc:304] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:05.718892 21248 raft_consensus.cc:2463] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:05.719750 21370 raft_consensus.cc:2798] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:05.719682 21364 raft_consensus.cc:357] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.719185 21366 consensus_queue.cc:260] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:05.720569 21364 raft_consensus.cc:383] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.720916 21364 raft_consensus.cc:738] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.721683 21364 consensus_queue.cc:260] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.724982 21365 tablet_bootstrap.cc:654] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.725812 21366 ts_tablet_manager.cc:1428] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20250109 21:10:05.726863 21366 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.728192 21364 ts_tablet_manager.cc:1428] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.011s user 0.004s sys 0.004s
I20250109 21:10:05.729346 21364 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.733440 21370 raft_consensus.cc:695] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:05.734853 21366 tablet_bootstrap.cc:654] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.734623 21370 consensus_queue.cc:237] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.742458 21364 tablet_bootstrap.cc:654] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.742681 21365 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.743170 21365 ts_tablet_manager.cc:1397] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.025s user 0.018s sys 0.005s
I20250109 21:10:05.746181 21365 raft_consensus.cc:357] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:05.750802 21365 raft_consensus.cc:383] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.751269 21365 raft_consensus.cc:738] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.753638 21365 consensus_queue.cc:260] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:05.756268 21365 ts_tablet_manager.cc:1428] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20250109 21:10:05.756439 21366 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.756677 21364 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.756908 21366 ts_tablet_manager.cc:1397] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.030s user 0.022s sys 0.000s
I20250109 21:10:05.757061 21364 ts_tablet_manager.cc:1397] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.028s user 0.011s sys 0.006s
I20250109 21:10:05.757155 21365 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.758540 21068 catalog_manager.cc:5526] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:05.759536 21366 raft_consensus.cc:357] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.760295 21366 raft_consensus.cc:383] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.760064 21364 raft_consensus.cc:357] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.760593 21366 raft_consensus.cc:738] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.760807 21364 raft_consensus.cc:383] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.762751 21364 raft_consensus.cc:738] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.763481 21364 consensus_queue.cc:260] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.763504 21365 tablet_bootstrap.cc:654] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.765903 21364 ts_tablet_manager.cc:1428] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20250109 21:10:05.766819 21364 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.761300 21366 consensus_queue.cc:260] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.772637 21366 ts_tablet_manager.cc:1428] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.015s user 0.008s sys 0.000s
I20250109 21:10:05.773690 21366 tablet_bootstrap.cc:492] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.777372 21364 tablet_bootstrap.cc:654] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.777788 21365 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.778158 21365 ts_tablet_manager.cc:1397] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.007s
I20250109 21:10:05.780005 21365 raft_consensus.cc:357] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.780704 21365 raft_consensus.cc:383] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.780966 21365 raft_consensus.cc:738] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.781664 21365 consensus_queue.cc:260] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.783617 21365 ts_tablet_manager.cc:1428] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20250109 21:10:05.784400 21365 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.785427 21366 tablet_bootstrap.cc:654] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.790297 21365 tablet_bootstrap.cc:654] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.797269 21366 tablet_bootstrap.cc:492] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.797689 21366 ts_tablet_manager.cc:1397] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.007s
I20250109 21:10:05.798033 21371 raft_consensus.cc:491] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.798619 21371 raft_consensus.cc:513] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.800174 21366 raft_consensus.cc:357] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.800704 21371 leader_election.cc:290] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.800725 21366 raft_consensus.cc:383] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.801230 21366 raft_consensus.cc:738] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.801529 21364 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.801849 21364 ts_tablet_manager.cc:1397] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.035s user 0.001s sys 0.009s
I20250109 21:10:05.801848 21366 consensus_queue.cc:260] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.803089 21365 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.802790 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703480173d7142d0b22a2ec903e1707d" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.803542 21365 ts_tablet_manager.cc:1397] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.019s user 0.011s sys 0.005s
W20250109 21:10:05.804414 21213 leader_election.cc:343] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.804428 21364 raft_consensus.cc:357] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.801784 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703480173d7142d0b22a2ec903e1707d" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.805253 21364 raft_consensus.cc:383] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.805533 21364 raft_consensus.cc:738] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.805744 21365 raft_consensus.cc:357] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.806392 21365 raft_consensus.cc:383] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250109 21:10:05.806335 21214 leader_election.cc:343] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.806769 21365 raft_consensus.cc:738] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.806962 21214 leader_election.cc:304] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:05.807468 21366 ts_tablet_manager.cc:1428] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20250109 21:10:05.807430 21365 consensus_queue.cc:260] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.808261 21371 raft_consensus.cc:2743] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:05.808423 21366 tablet_bootstrap.cc:492] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.808810 21371 raft_consensus.cc:491] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.809599 21365 ts_tablet_manager.cc:1428] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:10:05.809221 21371 raft_consensus.cc:513] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.810441 21365 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.811355 21371 leader_election.cc:290] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.814729 21366 tablet_bootstrap.cc:654] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.806120 21364 consensus_queue.cc:260] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.815992 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.816468 21365 tablet_bootstrap.cc:654] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:05.817315 21213 leader_election.cc:343] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.818259 21371 raft_consensus.cc:491] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.818723 21371 raft_consensus.cc:513] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.819485 21364 ts_tablet_manager.cc:1428] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.017s user 0.005s sys 0.001s
I20250109 21:10:05.820330 21364 tablet_bootstrap.cc:492] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.822106 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.824594 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.827651 21366 tablet_bootstrap.cc:492] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.828977 21366 ts_tablet_manager.cc:1397] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.021s user 0.010s sys 0.000s
W20250109 21:10:05.828253 21213 leader_election.cc:343] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:05.830801 21214 leader_election.cc:343] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.831353 21214 leader_election.cc:304] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:05.832511 21416 raft_consensus.cc:2743] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:05.832959 21371 leader_election.cc:290] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.835403 21366 raft_consensus.cc:357] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.835974 21364 tablet_bootstrap.cc:654] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.835964 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.836308 21366 raft_consensus.cc:383] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.836724 21366 raft_consensus.cc:738] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.836702 21324 raft_consensus.cc:2463] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:05.837682 21366 consensus_queue.cc:260] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.838205 21214 leader_election.cc:304] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:05.839237 21371 raft_consensus.cc:2798] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:05.839567 21371 raft_consensus.cc:491] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:05.839870 21371 raft_consensus.cc:3054] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.842414 21366 ts_tablet_manager.cc:1428] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20250109 21:10:05.843622 21366 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.848062 21371 raft_consensus.cc:513] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.850656 21366 tablet_bootstrap.cc:654] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.850558 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
W20250109 21:10:05.852281 21213 leader_election.cc:343] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.852666 21365 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.853078 21365 ts_tablet_manager.cc:1397] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.043s user 0.020s sys 0.004s
I20250109 21:10:05.854974 21365 raft_consensus.cc:357] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.855427 21371 leader_election.cc:290] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.855602 21365 raft_consensus.cc:383] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.855868 21365 raft_consensus.cc:738] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.856493 21365 consensus_queue.cc:260] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.858278 21364 tablet_bootstrap.cc:492] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.858873 21364 ts_tablet_manager.cc:1397] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.039s user 0.018s sys 0.007s
I20250109 21:10:05.861984 21364 raft_consensus.cc:357] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.862389 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:05.862648 21364 raft_consensus.cc:383] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.858337 21365 ts_tablet_manager.cc:1428] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250109 21:10:05.863030 21324 raft_consensus.cc:3054] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.863794 21365 tablet_bootstrap.cc:492] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.864151 21366 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.864532 21366 ts_tablet_manager.cc:1397] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.007s
I20250109 21:10:05.866698 21366 raft_consensus.cc:357] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.867340 21366 raft_consensus.cc:383] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.867574 21366 raft_consensus.cc:738] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.868395 21366 consensus_queue.cc:260] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.863006 21364 raft_consensus.cc:738] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.869524 21365 tablet_bootstrap.cc:654] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.870422 21364 consensus_queue.cc:260] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.869551 21324 raft_consensus.cc:2463] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:05.872182 21214 leader_election.cc:304] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:05.872614 21364 ts_tablet_manager.cc:1428] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20250109 21:10:05.873152 21371 raft_consensus.cc:2798] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:05.873538 21371 raft_consensus.cc:695] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:05.874179 21371 consensus_queue.cc:237] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.876760 21365 tablet_bootstrap.cc:492] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.877147 21365 ts_tablet_manager.cc:1397] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.014s user 0.004s sys 0.005s
I20250109 21:10:05.877359 21364 tablet_bootstrap.cc:492] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.877622 21366 ts_tablet_manager.cc:1428] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20250109 21:10:05.879439 21365 raft_consensus.cc:357] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.880084 21365 raft_consensus.cc:383] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.880345 21365 raft_consensus.cc:738] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.881421 21366 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.881008 21365 consensus_queue.cc:260] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.887235 21365 ts_tablet_manager.cc:1428] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250109 21:10:05.887493 21366 tablet_bootstrap.cc:654] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.888125 21365 tablet_bootstrap.cc:492] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.894795 21394 raft_consensus.cc:491] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.895475 21394 raft_consensus.cc:513] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.896682 21370 raft_consensus.cc:491] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.897132 21370 raft_consensus.cc:513] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.897111 21069 catalog_manager.cc:5526] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:05.897773 21394 leader_election.cc:290] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.899070 21370 leader_election.cc:290] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:05.899240 21365 tablet_bootstrap.cc:654] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.900748 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4271f4a728084e65b74f13aa9fa0c6c0" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:05.901340 21248 raft_consensus.cc:2463] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:05.902406 21416 raft_consensus.cc:491] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.902805 21416 raft_consensus.cc:513] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.904325 21364 tablet_bootstrap.cc:654] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.904786 21416 leader_election.cc:290] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.905624 21366 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.905520 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d399e14db94b4089b4e14d1212dee628" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.906101 21366 ts_tablet_manager.cc:1397] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.011s
I20250109 21:10:05.908560 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4271f4a728084e65b74f13aa9fa0c6c0" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.909000 21366 raft_consensus.cc:357] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.909737 21366 raft_consensus.cc:383] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.909991 21366 raft_consensus.cc:738] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.910671 21365 tablet_bootstrap.cc:492] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.910533 21366 consensus_queue.cc:260] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.911022 21364 tablet_bootstrap.cc:492] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:05.910960 21136 leader_election.cc:304] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:05.911432 21324 raft_consensus.cc:2463] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:05.911785 21394 raft_consensus.cc:2798] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:05.912138 21394 raft_consensus.cc:491] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:05.912456 21394 raft_consensus.cc:3054] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:05.912509 21288 leader_election.cc:343] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.912653 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4271f4a728084e65b74f13aa9fa0c6c0" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.913364 21323 raft_consensus.cc:2463] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:05.913447 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4271f4a728084e65b74f13aa9fa0c6c0" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:05.911110 21365 ts_tablet_manager.cc:1397] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.023s user 0.006s sys 0.006s
I20250109 21:10:05.914320 21416 raft_consensus.cc:491] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.914520 21214 leader_election.cc:304] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:05.914325 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d399e14db94b4089b4e14d1212dee628" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:05.915310 21371 raft_consensus.cc:2798] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:05.915601 21248 raft_consensus.cc:2463] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:05.915663 21371 raft_consensus.cc:491] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:05.916410 21371 raft_consensus.cc:3054] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.916572 21366 ts_tablet_manager.cc:1428] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250109 21:10:05.917167 21288 leader_election.cc:304] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:05.917418 21366 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.918555 21404 raft_consensus.cc:2798] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:05.918892 21404 raft_consensus.cc:491] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:05.919365 21404 raft_consensus.cc:3054] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.920064 21394 raft_consensus.cc:513] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.911585 21364 ts_tablet_manager.cc:1397] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.034s user 0.008s sys 0.002s
I20250109 21:10:05.922802 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4271f4a728084e65b74f13aa9fa0c6c0" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:05.924963 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4271f4a728084e65b74f13aa9fa0c6c0" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:05.925549 21323 raft_consensus.cc:3054] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.925616 21364 raft_consensus.cc:357] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.925906 21404 raft_consensus.cc:513] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.916595 21365 raft_consensus.cc:357] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.927219 21170 raft_consensus.cc:2388] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5d1eaae36f84176860e3799d49e4f53 in current term 1: Already voted for candidate 1774487f18694af1a5340fc8486cff53 in this term.
I20250109 21:10:05.927281 21365 raft_consensus.cc:383] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.927695 21365 raft_consensus.cc:738] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.928328 21365 consensus_queue.cc:260] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.914798 21416 raft_consensus.cc:513] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.930485 21365 ts_tablet_manager.cc:1428] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.016s user 0.001s sys 0.001s
I20250109 21:10:05.930752 21416 leader_election.cc:290] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.931557 21366 tablet_bootstrap.cc:654] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.931517 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:05.932878 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d399e14db94b4089b4e14d1212dee628" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:05.933477 21171 raft_consensus.cc:3054] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.933640 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
W20250109 21:10:05.932991 21214 leader_election.cc:343] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.934019 21365 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.934312 21170 raft_consensus.cc:2463] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:05.936113 21213 leader_election.cc:304] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:05.937696 21416 raft_consensus.cc:2798] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:05.938269 21416 raft_consensus.cc:491] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:05.938397 21371 raft_consensus.cc:513] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.940510 21371 leader_election.cc:290] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.941073 21171 raft_consensus.cc:2463] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:05.941809 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4271f4a728084e65b74f13aa9fa0c6c0" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:05.946125 21288 leader_election.cc:304] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:05.946273 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d399e14db94b4089b4e14d1212dee628" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:05.942890 21248 raft_consensus.cc:2388] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
I20250109 21:10:05.946975 21370 raft_consensus.cc:2798] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:05.943411 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4271f4a728084e65b74f13aa9fa0c6c0" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:05.947633 21370 raft_consensus.cc:695] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:05.947851 21170 raft_consensus.cc:2388] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5d1eaae36f84176860e3799d49e4f53 in current term 1: Already voted for candidate 1774487f18694af1a5340fc8486cff53 in this term.
I20250109 21:10:05.943547 21366 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.944811 21365 tablet_bootstrap.cc:654] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.947005 21247 raft_consensus.cc:3054] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.948441 21370 consensus_queue.cc:237] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.949000 21366 ts_tablet_manager.cc:1397] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.032s user 0.011s sys 0.007s
I20250109 21:10:05.951612 21366 raft_consensus.cc:357] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.952318 21366 raft_consensus.cc:383] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.952574 21366 raft_consensus.cc:738] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.953217 21404 leader_election.cc:290] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:05.953162 21366 consensus_queue.cc:260] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.955399 21247 raft_consensus.cc:2463] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:05.955896 21394 leader_election.cc:290] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.956701 21366 ts_tablet_manager.cc:1428] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:10:05.957566 21366 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.957511 21213 leader_election.cc:304] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:05.958668 21371 raft_consensus.cc:2743] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:05.938822 21416 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:05.963514 21366 tablet_bootstrap.cc:654] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.966035 21416 raft_consensus.cc:513] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.955446 21323 raft_consensus.cc:2463] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:05.966856 21069 catalog_manager.cc:5526] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:05.970794 21137 leader_election.cc:304] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:05.971820 21416 leader_election.cc:290] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:05.972819 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:05.973218 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:05.972852 21394 raft_consensus.cc:2798] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:05.973821 21170 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:05.973948 21214 leader_election.cc:343] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:05.974186 21394 raft_consensus.cc:695] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:05.975086 21365 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:05.974905 21394 consensus_queue.cc:237] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.975512 21365 ts_tablet_manager.cc:1397] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.042s user 0.019s sys 0.007s
I20250109 21:10:05.978013 21365 raft_consensus.cc:357] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.978709 21365 raft_consensus.cc:383] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.979000 21365 raft_consensus.cc:738] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.979527 21405 raft_consensus.cc:491] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.979965 21405 raft_consensus.cc:513] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.980170 21365 consensus_queue.cc:260] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.980726 21170 raft_consensus.cc:2463] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:05.981236 21366 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:05.981648 21366 ts_tablet_manager.cc:1397] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.003s
I20250109 21:10:05.981738 21213 leader_election.cc:304] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:05.982345 21365 ts_tablet_manager.cc:1428] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:10:05.982884 21416 raft_consensus.cc:2798] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:05.983177 21365 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:05.983361 21416 raft_consensus.cc:695] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:05.983583 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f660a562716e4048a180570218fae1d4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:05.984215 21366 raft_consensus.cc:357] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.981912 21405 leader_election.cc:290] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:05.984964 21366 raft_consensus.cc:383] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:05.985245 21366 raft_consensus.cc:738] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:05.985298 21405 raft_consensus.cc:491] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:05.984136 21416 consensus_queue.cc:237] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.985954 21366 consensus_queue.cc:260] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.988163 21366 ts_tablet_manager.cc:1428] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:05.984189 21247 raft_consensus.cc:2463] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:05.989099 21366 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:05.989670 21288 leader_election.cc:304] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:05.989925 21365 tablet_bootstrap.cc:654] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:05.990753 21405 raft_consensus.cc:513] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:05.992743 21405 leader_election.cc:290] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:05.995870 21370 raft_consensus.cc:2798] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:05.998833 21370 raft_consensus.cc:491] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:05.999256 21370 raft_consensus.cc:3054] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.003152 21365 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:06.003557 21365 ts_tablet_manager.cc:1397] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.021s user 0.008s sys 0.008s
I20250109 21:10:05.926352 21364 raft_consensus.cc:383] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.005021 21364 raft_consensus.cc:738] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.005854 21365 raft_consensus.cc:357] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.006534 21365 raft_consensus.cc:383] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.006775 21365 raft_consensus.cc:738] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.006109 21067 catalog_manager.cc:5526] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:06.007340 21365 consensus_queue.cc:260] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.008350 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f660a562716e4048a180570218fae1d4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.008977 21171 raft_consensus.cc:2463] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:06.009728 21365 ts_tablet_manager.cc:1428] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:06.006209 21364 consensus_queue.cc:260] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.010776 21365 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:06.011075 21364 ts_tablet_manager.cc:1428] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.088s user 0.005s sys 0.001s
I20250109 21:10:06.012090 21364 tablet_bootstrap.cc:492] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:05.996874 21366 tablet_bootstrap.cc:654] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.016741 21365 tablet_bootstrap.cc:654] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.017962 21364 tablet_bootstrap.cc:654] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.028194 21405 raft_consensus.cc:491] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.028685 21405 raft_consensus.cc:513] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.030759 21405 leader_election.cc:290] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.031440 21364 tablet_bootstrap.cc:492] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:06.031862 21364 ts_tablet_manager.cc:1397] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.020s user 0.006s sys 0.011s
I20250109 21:10:06.031769 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7c70db395b4c95bdd3a519fbff09f1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.032830 21365 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:06.033223 21365 ts_tablet_manager.cc:1397] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.023s user 0.010s sys 0.007s
I20250109 21:10:06.034266 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a619c9914d0d497ab180faa27e65a541" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.033100 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7c70db395b4c95bdd3a519fbff09f1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.034471 21364 raft_consensus.cc:357] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.034880 21170 raft_consensus.cc:2463] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:06.035144 21364 raft_consensus.cc:383] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250109 21:10:06.035192 21288 leader_election.cc:343] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.035434 21364 raft_consensus.cc:738] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.034852 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a619c9914d0d497ab180faa27e65a541" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.035948 21288 leader_election.cc:304] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:06.036147 21364 consensus_queue.cc:260] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.036681 21405 raft_consensus.cc:2798] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250109 21:10:06.036857 21288 leader_election.cc:343] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.037065 21247 raft_consensus.cc:2463] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:06.037483 21405 raft_consensus.cc:491] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.038012 21405 raft_consensus.cc:3054] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.039777 21366 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:06.039795 21364 ts_tablet_manager.cc:1428] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250109 21:10:06.040284 21366 ts_tablet_manager.cc:1397] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.051s user 0.006s sys 0.004s
I20250109 21:10:06.040819 21364 tablet_bootstrap.cc:492] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:06.042728 21366 raft_consensus.cc:357] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.043448 21366 raft_consensus.cc:383] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.043709 21366 raft_consensus.cc:738] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.043067 21069 catalog_manager.cc:5526] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:06.044310 21366 consensus_queue.cc:260] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.044878 21405 raft_consensus.cc:513] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.045248 21370 raft_consensus.cc:513] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.046514 21364 tablet_bootstrap.cc:654] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.046703 21405 leader_election.cc:290] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.047035 21370 leader_election.cc:290] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.037915 21288 leader_election.cc:304] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.048527 21365 raft_consensus.cc:357] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.049180 21366 ts_tablet_manager.cc:1428] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250109 21:10:06.049304 21365 raft_consensus.cc:383] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.049679 21365 raft_consensus.cc:738] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.050006 21366 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:06.050400 21365 consensus_queue.cc:260] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.056073 21366 tablet_bootstrap.cc:654] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.056416 21395 raft_consensus.cc:491] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.056983 21395 raft_consensus.cc:513] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.060638 21370 raft_consensus.cc:2743] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:06.061329 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f660a562716e4048a180570218fae1d4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:06.062077 21170 raft_consensus.cc:3054] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.062245 21394 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:06.066202 21405 raft_consensus.cc:491] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.066629 21405 raft_consensus.cc:513] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.068181 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a619c9914d0d497ab180faa27e65a541" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.068406 21405 leader_election.cc:290] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.068756 21247 raft_consensus.cc:3054] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.069782 21395 leader_election.cc:290] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.070290 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800dbae8cc64427c8e80cc1ac7b42769" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.071233 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f660a562716e4048a180570218fae1d4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.071909 21248 raft_consensus.cc:3054] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.072685 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.073362 21246 raft_consensus.cc:2463] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:06.074477 21136 leader_election.cc:304] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
W20250109 21:10:06.075189 21288 leader_election.cc:343] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.071182 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:06.075961 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800dbae8cc64427c8e80cc1ac7b42769" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.076287 21365 ts_tablet_manager.cc:1428] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.043s user 0.007s sys 0.000s
W20250109 21:10:06.077322 21288 leader_election.cc:343] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:06.077389 21137 leader_election.cc:343] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.077806 21288 leader_election.cc:304] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.078549 21405 raft_consensus.cc:2743] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:06.079209 21395 raft_consensus.cc:2798] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.079566 21395 raft_consensus.cc:491] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.079885 21395 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.080256 21365 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:06.087277 21247 raft_consensus.cc:2463] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.088651 21288 leader_election.cc:304] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:06.089679 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a619c9914d0d497ab180faa27e65a541" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:06.090272 21171 raft_consensus.cc:3054] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.090701 21405 raft_consensus.cc:2798] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.092657 21405 raft_consensus.cc:695] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:06.098894 21170 raft_consensus.cc:2463] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.092196 21365 tablet_bootstrap.cc:654] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.099418 21405 consensus_queue.cc:237] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.100119 21248 raft_consensus.cc:2463] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
W20250109 21:10:06.106551 21136 consensus_peers.cc:487] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:06.107179 21288 leader_election.cc:304] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:06.107992 21370 raft_consensus.cc:2798] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.108493 21370 raft_consensus.cc:695] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:06.109259 21370 consensus_queue.cc:237] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.117965 21171 raft_consensus.cc:2463] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.130060 21372 raft_consensus.cc:491] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.130685 21372 raft_consensus.cc:513] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.134192 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:06.135129 21324 raft_consensus.cc:2388] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
I20250109 21:10:06.142468 21372 leader_election.cc:290] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.086524 21395 raft_consensus.cc:513] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.146473 21366 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:06.146939 21366 ts_tablet_manager.cc:1397] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.097s user 0.012s sys 0.004s
I20250109 21:10:06.147297 21365 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:06.147734 21365 ts_tablet_manager.cc:1397] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.068s user 0.014s sys 0.000s
I20250109 21:10:06.148976 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.149317 21366 raft_consensus.cc:357] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.150009 21366 raft_consensus.cc:383] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.150283 21366 raft_consensus.cc:738] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.150084 21365 raft_consensus.cc:357] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.151001 21365 raft_consensus.cc:383] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.151351 21365 raft_consensus.cc:738] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.151067 21136 leader_election.cc:304] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.152274 21364 tablet_bootstrap.cc:492] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:06.152014 21365 consensus_queue.cc:260] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.152779 21364 ts_tablet_manager.cc:1397] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.112s user 0.038s sys 0.038s
I20250109 21:10:06.153998 21365 ts_tablet_manager.cc:1428] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:06.152623 21372 raft_consensus.cc:3054] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.156888 21365 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:06.156320 21364 raft_consensus.cc:357] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.160180 21395 leader_election.cc:290] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.150974 21366 consensus_queue.cc:260] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.161430 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.162808 21248 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.163290 21365 tablet_bootstrap.cc:654] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.163887 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
W20250109 21:10:06.165086 21137 leader_election.cc:343] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.162071 21394 raft_consensus.cc:491] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.166354 21394 raft_consensus.cc:513] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:06.168645 21394 leader_election.cc:290] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.168118 21069 catalog_manager.cc:5526] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:06.159968 21364 raft_consensus.cc:383] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.170406 21364 raft_consensus.cc:738] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.170360 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:06.171480 21323 raft_consensus.cc:2463] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:06.172541 21137 leader_election.cc:304] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:06.173317 21394 raft_consensus.cc:2798] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.173679 21394 raft_consensus.cc:491] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.174055 21394 raft_consensus.cc:3054] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.175588 21432 raft_consensus.cc:491] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.176127 21432 raft_consensus.cc:513] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.178335 21432 leader_election.cc:290] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.179970 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.180776 21171 raft_consensus.cc:2463] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:06.181521 21364 consensus_queue.cc:260] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.180541 21394 raft_consensus.cc:513] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:06.183765 21364 ts_tablet_manager.cc:1428] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.031s user 0.005s sys 0.004s
I20250109 21:10:06.184604 21364 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:06.185125 21366 ts_tablet_manager.cc:1428] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.038s user 0.005s sys 0.000s
I20250109 21:10:06.185163 21394 leader_election.cc:290] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.185319 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:06.185874 21323 raft_consensus.cc:3054] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.186980 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.187531 21247 raft_consensus.cc:2463] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:06.189787 21365 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:06.192821 21248 raft_consensus.cc:2463] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:06.191474 21364 tablet_bootstrap.cc:654] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.191982 21323 raft_consensus.cc:2463] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:06.196324 21137 leader_election.cc:304] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:06.196835 21372 raft_consensus.cc:2743] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:06.197091 21394 raft_consensus.cc:2798] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.193043 21365 ts_tablet_manager.cc:1397] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.036s user 0.012s sys 0.015s
I20250109 21:10:06.190574 21288 leader_election.cc:304] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:06.186028 21366 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:06.197515 21394 raft_consensus.cc:695] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:06.198326 21394 consensus_queue.cc:237] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:06.198484 21067 catalog_manager.cc:5526] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:06.200469 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.200039 21365 raft_consensus.cc:357] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.201362 21370 raft_consensus.cc:2798] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.203130 21247 raft_consensus.cc:3054] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.203292 21370 raft_consensus.cc:491] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.203219 21365 raft_consensus.cc:383] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.203744 21370 raft_consensus.cc:3054] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.203970 21365 raft_consensus.cc:738] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.205228 21366 tablet_bootstrap.cc:654] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.205263 21365 consensus_queue.cc:260] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.208258 21365 ts_tablet_manager.cc:1428] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20250109 21:10:06.210564 21365 tablet_bootstrap.cc:492] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:06.212162 21247 raft_consensus.cc:2463] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:06.201232 21136 leader_election.cc:304] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:06.213443 21372 raft_consensus.cc:2798] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.202296 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.213971 21372 raft_consensus.cc:695] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:06.214299 21248 raft_consensus.cc:2371] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1. Re-sending same reply.
I20250109 21:10:06.215070 21372 consensus_queue.cc:237] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.217657 21365 tablet_bootstrap.cc:654] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.218798 21432 raft_consensus.cc:491] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.221400 21432 raft_consensus.cc:513] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.225183 21364 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:06.225124 21432 leader_election.cc:290] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.210697 21370 raft_consensus.cc:513] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.225616 21364 ts_tablet_manager.cc:1397] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.041s user 0.007s sys 0.014s
I20250109 21:10:06.226759 21370 leader_election.cc:290] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.228229 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:06.228957 21170 raft_consensus.cc:3054] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.229173 21069 catalog_manager.cc:5526] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:06.229931 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16dee0cc12b842ec877d167505529061" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.230517 21248 raft_consensus.cc:2463] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:06.231495 21288 leader_election.cc:304] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:06.232304 21370 raft_consensus.cc:2798] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.232635 21370 raft_consensus.cc:491] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.232972 21370 raft_consensus.cc:3054] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.228348 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16dee0cc12b842ec877d167505529061" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
W20250109 21:10:06.236563 21288 leader_election.cc:343] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.239491 21170 raft_consensus.cc:2463] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.240175 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.240691 21288 leader_election.cc:304] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:06.241940 21432 raft_consensus.cc:2798] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.227910 21364 raft_consensus.cc:357] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.242380 21432 raft_consensus.cc:695] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:06.242543 21364 raft_consensus.cc:383] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.242605 21366 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:06.242806 21364 raft_consensus.cc:738] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.243111 21366 ts_tablet_manager.cc:1397] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.057s user 0.011s sys 0.004s
I20250109 21:10:06.243448 21432 consensus_queue.cc:237] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.243686 21364 consensus_queue.cc:260] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.245831 21364 ts_tablet_manager.cc:1428] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20250109 21:10:06.246066 21366 raft_consensus.cc:357] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.246595 21364 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:06.240721 21247 raft_consensus.cc:3054] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.238713 21370 raft_consensus.cc:513] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.254143 21364 tablet_bootstrap.cc:654] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.254570 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16dee0cc12b842ec877d167505529061" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:06.255122 21405 raft_consensus.cc:491] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:06.255800 21288 leader_election.cc:343] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.255568 21405 raft_consensus.cc:513] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.257445 21405 leader_election.cc:290] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.258147 21370 leader_election.cc:290] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.258420 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba485e8800045ec8e33924e02890beb" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.259052 21170 raft_consensus.cc:2463] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:06.261494 21288 leader_election.cc:304] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:06.262254 21432 raft_consensus.cc:2798] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.262511 21247 raft_consensus.cc:2463] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.263234 21395 raft_consensus.cc:491] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.266681 21395 raft_consensus.cc:513] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.269059 21395 leader_election.cc:290] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.270925 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7c70db395b4c95bdd3a519fbff09f1" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:06.272158 21136 leader_election.cc:343] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.272073 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7c70db395b4c95bdd3a519fbff09f1" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:06.273065 21323 raft_consensus.cc:2463] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:06.274319 21395 raft_consensus.cc:491] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.274658 21137 leader_election.cc:304] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.274921 21395 raft_consensus.cc:513] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.276074 21394 raft_consensus.cc:2798] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.276556 21394 raft_consensus.cc:491] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.246672 21366 raft_consensus.cc:383] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.264024 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16dee0cc12b842ec877d167505529061" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.277967 21246 raft_consensus.cc:3054] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.280027 21395 leader_election.cc:290] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.280668 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703480173d7142d0b22a2ec903e1707d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.281298 21247 raft_consensus.cc:2463] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:06.282249 21136 leader_election.cc:304] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:06.282465 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703480173d7142d0b22a2ec903e1707d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:06.282972 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba485e8800045ec8e33924e02890beb" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:06.284372 21288 leader_election.cc:343] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.276952 21394 raft_consensus.cc:3054] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.283172 21395 raft_consensus.cc:2798] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.285161 21395 raft_consensus.cc:491] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.285488 21395 raft_consensus.cc:3054] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.288363 21067 catalog_manager.cc:5526] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:06.291308 21370 raft_consensus.cc:491] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:06.291575 21137 leader_election.cc:343] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.291774 21370 raft_consensus.cc:513] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.293705 21370 leader_election.cc:290] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.295321 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c404ac7e616f4de9b6df5a2d9259a4b6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.296094 21395 raft_consensus.cc:513] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:06.296638 21288 leader_election.cc:343] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.298593 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703480173d7142d0b22a2ec903e1707d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.262775 21432 raft_consensus.cc:491] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.299170 21247 raft_consensus.cc:3054] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.299332 21432 raft_consensus.cc:3054] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.299968 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c404ac7e616f4de9b6df5a2d9259a4b6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:06.301177 21288 leader_election.cc:343] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.301579 21288 leader_election.cc:304] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.302284 21370 raft_consensus.cc:2743] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:06.313956 21247 raft_consensus.cc:2463] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:06.314989 21136 leader_election.cc:304] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:06.315651 21067 catalog_manager.cc:5526] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:06.317183 21366 raft_consensus.cc:738] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.318204 21366 consensus_queue.cc:260] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.319419 21246 raft_consensus.cc:2463] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.320894 21372 raft_consensus.cc:2798] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.322140 21372 raft_consensus.cc:695] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:06.316509 21394 raft_consensus.cc:513] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.320984 21453 raft_consensus.cc:491] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.323884 21288 leader_election.cc:304] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:06.326869 21370 raft_consensus.cc:2798] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.327533 21370 raft_consensus.cc:695] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:06.328299 21370 consensus_queue.cc:237] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.330672 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7c70db395b4c95bdd3a519fbff09f1" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:06.331270 21323 raft_consensus.cc:3054] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.324321 21453 raft_consensus.cc:513] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.336107 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a65a2d287ce4921be6fe0d816e85fd8" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:06.323012 21372 consensus_queue.cc:237] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.340209 21453 leader_election.cc:290] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
W20250109 21:10:06.340978 21137 leader_election.cc:343] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.343518 21365 tablet_bootstrap.cc:492] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:06.344151 21365 ts_tablet_manager.cc:1397] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.134s user 0.018s sys 0.007s
I20250109 21:10:06.344355 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a65a2d287ce4921be6fe0d816e85fd8" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:06.346283 21136 leader_election.cc:343] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.347298 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7c70db395b4c95bdd3a519fbff09f1" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.346808 21136 leader_election.cc:304] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
W20250109 21:10:06.349159 21136 leader_election.cc:343] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.350302 21453 raft_consensus.cc:2743] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:06.350600 21404 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.351830 21404 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.352313 21395 leader_election.cc:290] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.353531 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703480173d7142d0b22a2ec903e1707d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
W20250109 21:10:06.355233 21137 leader_election.cc:343] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.361743 21395 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:06.362699 21323 raft_consensus.cc:2463] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:06.364151 21137 leader_election.cc:304] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.331235 21394 leader_election.cc:290] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.326370 21366 ts_tablet_manager.cc:1428] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.083s user 0.006s sys 0.000s
I20250109 21:10:06.367718 21366 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:06.370730 21364 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:06.366168 21394 raft_consensus.cc:2798] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.371203 21364 ts_tablet_manager.cc:1397] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.125s user 0.051s sys 0.061s
I20250109 21:10:06.371480 21394 raft_consensus.cc:695] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:06.376109 21364 raft_consensus.cc:357] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.376770 21364 raft_consensus.cc:383] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.377102 21364 raft_consensus.cc:738] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.377698 21364 consensus_queue.cc:260] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.380244 21394 consensus_queue.cc:237] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.384680 21395 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.381528 21364 ts_tablet_manager.cc:1428] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.010s user 0.002s sys 0.004s
I20250109 21:10:06.386543 21366 tablet_bootstrap.cc:654] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.386656 21364 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:06.370646 21432 raft_consensus.cc:513] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.389835 21432 leader_election.cc:290] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.347529 21365 raft_consensus.cc:357] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.390376 21365 raft_consensus.cc:383] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.390632 21365 raft_consensus.cc:738] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.390681 21416 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:06.391250 21365 consensus_queue.cc:260] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.393354 21365 ts_tablet_manager.cc:1428] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.049s user 0.004s sys 0.000s
I20250109 21:10:06.394156 21365 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:06.394305 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba485e8800045ec8e33924e02890beb" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:06.395910 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba485e8800045ec8e33924e02890beb" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.394829 21171 raft_consensus.cc:3054] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:06.399259 21288 leader_election.cc:343] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.405788 21364 tablet_bootstrap.cc:654] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.406402 21171 raft_consensus.cc:2463] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.407709 21288 leader_election.cc:304] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.408937 21370 raft_consensus.cc:2798] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.409688 21370 raft_consensus.cc:695] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:06.410604 21370 consensus_queue.cc:237] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.412817 21365 tablet_bootstrap.cc:654] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.412294 21067 catalog_manager.cc:5526] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:06.429055 21404 consensus_queue.cc:1035] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.458351 21416 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:06.469383 21066 catalog_manager.cc:5526] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:06.494707 21372 raft_consensus.cc:491] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.495334 21372 raft_consensus.cc:513] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.500005 21323 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.501447 21372 leader_election.cc:290] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.503350 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16dee0cc12b842ec877d167505529061" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:06.542107 21404 raft_consensus.cc:491] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.667245 21404 raft_consensus.cc:513] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.668162 21364 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:06.668722 21364 ts_tablet_manager.cc:1397] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.282s user 0.069s sys 0.088s
I20250109 21:10:06.670648 21404 leader_election.cc:290] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.671113 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35869458d4934257a5392c4158bc4cd1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.671979 21170 raft_consensus.cc:2463] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
W20250109 21:10:06.651041 21460 log.cc:926] Time spent T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53: Append to log took a long time: real 0.123s user 0.003s sys 0.008s
I20250109 21:10:06.652351 21366 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:06.673522 21366 ts_tablet_manager.cc:1397] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.306s user 0.008s sys 0.027s
I20250109 21:10:06.671360 21404 consensus_queue.cc:1035] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20250109 21:10:06.673421 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35869458d4934257a5392c4158bc4cd1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.680045 21247 raft_consensus.cc:2463] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:06.676668 21366 raft_consensus.cc:357] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.681154 21366 raft_consensus.cc:383] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.661513 21365 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:06.681461 21366 raft_consensus.cc:738] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.681922 21365 ts_tablet_manager.cc:1397] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.288s user 0.017s sys 0.028s
I20250109 21:10:06.682322 21366 consensus_queue.cc:260] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.685037 21365 raft_consensus.cc:357] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.685899 21365 raft_consensus.cc:383] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.686138 21366 ts_tablet_manager.cc:1428] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.012s user 0.006s sys 0.000s
I20250109 21:10:06.687593 21366 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:06.686208 21365 raft_consensus.cc:738] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.689738 21365 consensus_queue.cc:260] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.692299 21365 ts_tablet_manager.cc:1428] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.010s user 0.003s sys 0.003s
W20250109 21:10:06.690363 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:06.693390 21365 tablet_bootstrap.cc:492] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:06.692842 21067 catalog_manager.cc:5526] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:06.695680 21366 tablet_bootstrap.cc:654] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.527149 21416 raft_consensus.cc:491] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.678280 21288 leader_election.cc:304] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:06.698004 21432 raft_consensus.cc:2798] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.698479 21432 raft_consensus.cc:491] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.698872 21432 raft_consensus.cc:3054] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.679311 21405 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.700414 21370 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:06.701332 21364 raft_consensus.cc:357] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.702600 21364 raft_consensus.cc:383] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.702874 21364 raft_consensus.cc:738] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.704125 21370 raft_consensus.cc:491] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.704744 21370 raft_consensus.cc:513] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.705101 21364 consensus_queue.cc:260] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.707211 21472 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.713181 21364 ts_tablet_manager.cc:1428] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.044s user 0.006s sys 0.000s
I20250109 21:10:06.712877 21432 raft_consensus.cc:513] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.715432 21432 leader_election.cc:290] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.717267 21364 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:06.719038 21371 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.720964 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.723937 21364 tablet_bootstrap.cc:654] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.728091 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16dee0cc12b842ec877d167505529061" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.729082 21248 raft_consensus.cc:2388] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:06.732609 21366 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:06.733130 21366 ts_tablet_manager.cc:1397] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.046s user 0.009s sys 0.000s
I20250109 21:10:06.735601 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35869458d4934257a5392c4158bc4cd1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:06.736366 21168 raft_consensus.cc:3054] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.736796 21136 leader_election.cc:304] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.737531 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35869458d4934257a5392c4158bc4cd1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:06.738281 21246 raft_consensus.cc:3054] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.740435 21394 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.736364 21364 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:06.745139 21364 ts_tablet_manager.cc:1397] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.028s user 0.011s sys 0.005s
I20250109 21:10:06.746035 21246 raft_consensus.cc:2463] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.737551 21372 raft_consensus.cc:3054] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.749624 21364 raft_consensus.cc:357] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.753417 21364 raft_consensus.cc:383] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.753803 21364 raft_consensus.cc:738] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.754606 21364 consensus_queue.cc:260] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.758363 21372 raft_consensus.cc:2743] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:06.752355 21370 leader_election.cc:290] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.752883 21168 raft_consensus.cc:2463] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:06.762259 21288 leader_election.cc:304] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:06.763262 21432 consensus_queue.cc:1035] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.763638 21405 raft_consensus.cc:2798] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:06.764294 21405 raft_consensus.cc:695] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:06.765345 21405 consensus_queue.cc:237] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.765690 21069 catalog_manager.cc:5526] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:06.767196 21364 ts_tablet_manager.cc:1428] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.022s user 0.006s sys 0.001s
I20250109 21:10:06.775028 21364 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:06.775876 21416 raft_consensus.cc:513] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.777375 21248 raft_consensus.cc:3054] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:06.781185 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.785974 21395 consensus_queue.cc:1035] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.787822 21395 raft_consensus.cc:491] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.788246 21395 raft_consensus.cc:513] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.790182 21395 leader_election.cc:290] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.791900 21245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.792913 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:06.794134 21136 leader_election.cc:343] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.795612 21364 tablet_bootstrap.cc:654] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:06.799795 21137 consensus_peers.cc:487] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:06.804087 21476 raft_consensus.cc:491] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.804503 21288 leader_election.cc:304] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.804662 21476 raft_consensus.cc:513] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.805322 21370 raft_consensus.cc:2743] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:06.806185 21404 consensus_queue.cc:1035] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.806684 21476 leader_election.cc:290] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:06.807219 21476 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:06.808053 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a4ca66c3087428aaf05f37bc1ba32ee" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.811265 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:06.813577 21137 leader_election.cc:343] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.813757 21416 leader_election.cc:290] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.814013 21137 leader_election.cc:304] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:06.815410 21372 raft_consensus.cc:2743] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:06.816496 21288 leader_election.cc:343] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:06.819911 21365 tablet_bootstrap.cc:654] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:06.825793 21364 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:06.826231 21364 ts_tablet_manager.cc:1397] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.051s user 0.013s sys 0.003s
I20250109 21:10:06.827270 21454 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:06.827456 21366 raft_consensus.cc:357] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.828101 21366 raft_consensus.cc:383] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.828413 21366 raft_consensus.cc:738] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:06.828150 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a4ca66c3087428aaf05f37bc1ba32ee" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:06.829021 21366 consensus_queue.cc:260] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.852187 21366 ts_tablet_manager.cc:1428] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.119s user 0.008s sys 0.001s
I20250109 21:10:06.850616 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:06.856240 21214 leader_election.cc:304] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:06.858008 21366 tablet_bootstrap.cc:492] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:06.858762 21473 raft_consensus.cc:2743] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:06.878013 21394 consensus_queue.cc:1035] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:06.882134 21364 raft_consensus.cc:357] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.885387 21364 raft_consensus.cc:383] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:06.885766 21364 raft_consensus.cc:738] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
W20250109 21:10:06.892215 21137 consensus_peers.cc:487] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:06.929404 21371 raft_consensus.cc:491] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:06.929929 21371 raft_consensus.cc:513] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:06.968936 21371 leader_election.cc:290] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:06.970324 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a65a2d287ce4921be6fe0d816e85fd8" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:06.971024 21171 raft_consensus.cc:2463] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:06.972178 21213 leader_election.cc:304] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:06.973990 21371 raft_consensus.cc:2798] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:06.974351 21371 raft_consensus.cc:491] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:06.974751 21371 raft_consensus.cc:3054] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:06.985570 21492 log.cc:926] Time spent T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53: Append to log took a long time: real 0.102s user 0.000s sys 0.001s
I20250109 21:10:07.011751 21364 consensus_queue.cc:260] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.016347 21246 raft_consensus.cc:2463] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:07.018424 21370 raft_consensus.cc:491] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.018888 21370 raft_consensus.cc:513] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.023684 21370 leader_election.cc:290] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
W20250109 21:10:07.028611 21479 log.cc:926] Time spent T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53: Append to log took a long time: real 0.115s user 0.007s sys 0.005s
I20250109 21:10:07.030901 21069 catalog_manager.cc:5526] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:07.032449 21405 consensus_queue.cc:1035] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:07.050700 21371 raft_consensus.cc:513] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.052656 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:07.054615 21371 leader_election.cc:290] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.055959 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a65a2d287ce4921be6fe0d816e85fd8" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:07.056538 21168 raft_consensus.cc:3054] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.057051 21395 consensus_queue.cc:1035] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:07.057638 21366 tablet_bootstrap.cc:654] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.060962 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:07.061931 21171 raft_consensus.cc:2463] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:07.063050 21365 tablet_bootstrap.cc:492] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.063602 21365 ts_tablet_manager.cc:1397] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.370s user 0.016s sys 0.007s
W20250109 21:10:07.067248 21136 consensus_peers.cc:487] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:07.068607 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a65a2d287ce4921be6fe0d816e85fd8" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:07.069584 21365 raft_consensus.cc:357] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:07.070079 21214 leader_election.cc:343] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.070371 21365 raft_consensus.cc:383] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.070973 21365 raft_consensus.cc:738] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.071730 21365 consensus_queue.cc:260] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.073761 21364 ts_tablet_manager.cc:1428] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.247s user 0.020s sys 0.028s
I20250109 21:10:07.074246 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a65a2d287ce4921be6fe0d816e85fd8" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:07.074973 21364 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:07.074007 21365 ts_tablet_manager.cc:1428] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
W20250109 21:10:07.077503 21214 leader_election.cc:343] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.077198 21168 raft_consensus.cc:2463] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:07.080950 21365 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:07.083709 21213 leader_election.cc:304] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:07.086499 21371 raft_consensus.cc:2798] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:07.087217 21371 raft_consensus.cc:695] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:07.089342 21371 consensus_queue.cc:237] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.096067 21405 consensus_queue.cc:1035] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:07.100770 21288 leader_election.cc:304] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:07.102360 21476 raft_consensus.cc:2798] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:07.102710 21476 raft_consensus.cc:491] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:07.103879 21370 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:07.103087 21476 raft_consensus.cc:3054] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:07.115458 21288 leader_election.cc:343] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.118356 21288 leader_election.cc:304] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:07.118506 21404 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:07.106066 21364 tablet_bootstrap.cc:654] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.122601 21370 raft_consensus.cc:2798] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:07.129338 21247 raft_consensus.cc:3054] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.129216 21370 raft_consensus.cc:491] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:07.135536 21370 raft_consensus.cc:3054] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.165019 21476 raft_consensus.cc:513] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.182276 21365 tablet_bootstrap.cc:654] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.188360 21370 raft_consensus.cc:513] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.193516 21405 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:07.197067 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a4ca66c3087428aaf05f37bc1ba32ee" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:07.197638 21370 leader_election.cc:290] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:07.209091 21364 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:07.209682 21364 ts_tablet_manager.cc:1397] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.135s user 0.014s sys 0.010s
I20250109 21:10:07.212996 21364 raft_consensus.cc:357] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.213908 21364 raft_consensus.cc:383] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.214226 21364 raft_consensus.cc:738] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.214823 21364 consensus_queue.cc:260] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.223196 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
W20250109 21:10:07.214854 21288 leader_election.cc:343] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.223837 21171 raft_consensus.cc:3054] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.227633 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:07.227936 21364 ts_tablet_manager.cc:1428] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20250109 21:10:07.228706 21364 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
W20250109 21:10:07.229995 21288 leader_election.cc:343] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.233978 21365 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.234460 21365 ts_tablet_manager.cc:1397] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.154s user 0.015s sys 0.014s
I20250109 21:10:07.237768 21366 tablet_bootstrap.cc:492] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:07.238195 21366 ts_tablet_manager.cc:1397] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.385s user 0.018s sys 0.009s
I20250109 21:10:07.240273 21476 leader_election.cc:290] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:07.240777 21171 raft_consensus.cc:2463] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:07.241935 21288 leader_election.cc:304] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:07.243391 21432 raft_consensus.cc:2798] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:07.243850 21432 raft_consensus.cc:695] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:07.241287 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a4ca66c3087428aaf05f37bc1ba32ee" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:07.244659 21432 consensus_queue.cc:237] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.249797 21366 raft_consensus.cc:357] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.250808 21366 raft_consensus.cc:383] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.251173 21366 raft_consensus.cc:738] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.251771 21454 raft_consensus.cc:491] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.251833 21366 consensus_queue.cc:260] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.252300 21454 raft_consensus.cc:513] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.254233 21454 leader_election.cc:290] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.255103 21365 raft_consensus.cc:357] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.255801 21365 raft_consensus.cc:383] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.256093 21365 raft_consensus.cc:738] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.256211 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c404ac7e616f4de9b6df5a2d9259a4b6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:07.256671 21365 consensus_queue.cc:260] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.257064 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c404ac7e616f4de9b6df5a2d9259a4b6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:07.257761 21323 raft_consensus.cc:2463] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
W20250109 21:10:07.258211 21136 leader_election.cc:343] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.258930 21365 ts_tablet_manager.cc:1428] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.024s user 0.002s sys 0.000s
I20250109 21:10:07.258970 21137 leader_election.cc:304] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:07.259953 21365 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:07.260118 21394 raft_consensus.cc:2798] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:07.260460 21394 raft_consensus.cc:491] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:07.260797 21394 raft_consensus.cc:3054] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.244654 21247 raft_consensus.cc:3054] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.262667 21323 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.263701 21366 ts_tablet_manager.cc:1428] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.025s user 0.006s sys 0.001s
I20250109 21:10:07.264555 21366 tablet_bootstrap.cc:492] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:07.264396 21067 catalog_manager.cc:5526] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:07.273993 21364 tablet_bootstrap.cc:654] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.284896 21394 raft_consensus.cc:513] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.288214 21247 raft_consensus.cc:2463] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:07.289316 21288 leader_election.cc:304] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:07.289654 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c404ac7e616f4de9b6df5a2d9259a4b6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
W20250109 21:10:07.291010 21136 leader_election.cc:343] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.293339 21370 raft_consensus.cc:2798] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:07.293470 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c404ac7e616f4de9b6df5a2d9259a4b6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:07.293973 21370 raft_consensus.cc:695] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:07.294080 21322 raft_consensus.cc:3054] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.273988 21365 tablet_bootstrap.cc:654] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.295195 21370 consensus_queue.cc:237] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.302042 21322 raft_consensus.cc:2463] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:07.311422 21137 leader_election.cc:304] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:07.312456 21395 raft_consensus.cc:2798] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:07.313042 21395 raft_consensus.cc:695] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:07.314464 21366 tablet_bootstrap.cc:654] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.314076 21395 consensus_queue.cc:237] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.301882 21394 leader_election.cc:290] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.342185 21364 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:07.342634 21364 ts_tablet_manager.cc:1397] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.114s user 0.016s sys 0.012s
I20250109 21:10:07.345099 21364 raft_consensus.cc:357] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.345757 21364 raft_consensus.cc:383] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.346027 21364 raft_consensus.cc:738] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.344835 21066 catalog_manager.cc:5526] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:07.349320 21069 catalog_manager.cc:5526] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:07.350477 21365 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.350844 21365 ts_tablet_manager.cc:1397] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.091s user 0.006s sys 0.021s
I20250109 21:10:07.353111 21365 raft_consensus.cc:357] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.353726 21365 raft_consensus.cc:383] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.353982 21365 raft_consensus.cc:738] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.346603 21364 consensus_queue.cc:260] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.354986 21404 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:07.359127 21364 ts_tablet_manager.cc:1428] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20250109 21:10:07.359768 21364 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:07.354532 21365 consensus_queue.cc:260] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.365736 21365 ts_tablet_manager.cc:1428] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.015s user 0.004s sys 0.000s
I20250109 21:10:07.366534 21365 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:07.372259 21364 tablet_bootstrap.cc:654] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.373975 21404 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:07.376803 21365 tablet_bootstrap.cc:654] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.386797 21366 tablet_bootstrap.cc:492] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:07.390645 21366 ts_tablet_manager.cc:1397] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.126s user 0.011s sys 0.024s
I20250109 21:10:07.391944 21365 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.392349 21365 ts_tablet_manager.cc:1397] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.026s user 0.013s sys 0.000s
I20250109 21:10:07.393028 21366 raft_consensus.cc:357] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.393728 21366 raft_consensus.cc:383] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.393980 21366 raft_consensus.cc:738] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.394582 21366 consensus_queue.cc:260] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.395618 21365 raft_consensus.cc:357] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.396396 21365 raft_consensus.cc:383] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.396755 21365 raft_consensus.cc:738] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.397485 21366 ts_tablet_manager.cc:1428] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:10:07.397357 21365 consensus_queue.cc:260] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.399149 21364 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:07.399415 21365 ts_tablet_manager.cc:1428] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250109 21:10:07.399603 21364 ts_tablet_manager.cc:1397] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.040s user 0.008s sys 0.007s
I20250109 21:10:07.400255 21365 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:07.400336 21366 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:07.403211 21364 raft_consensus.cc:357] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.403911 21364 raft_consensus.cc:383] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.404179 21364 raft_consensus.cc:738] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.404841 21364 consensus_queue.cc:260] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.406901 21068 catalog_manager.cc:5526] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:07.409109 21364 ts_tablet_manager.cc:1428] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250109 21:10:07.409142 21366 tablet_bootstrap.cc:654] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.410115 21364 tablet_bootstrap.cc:492] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:07.411178 21365 tablet_bootstrap.cc:654] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.416110 21364 tablet_bootstrap.cc:654] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.438359 21365 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.438767 21365 ts_tablet_manager.cc:1397] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.021s
I20250109 21:10:07.440666 21364 tablet_bootstrap.cc:492] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:07.440675 21366 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:07.441308 21366 ts_tablet_manager.cc:1397] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.041s user 0.011s sys 0.016s
I20250109 21:10:07.441308 21364 ts_tablet_manager.cc:1397] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.031s user 0.008s sys 0.012s
I20250109 21:10:07.441223 21365 raft_consensus.cc:357] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.441995 21365 raft_consensus.cc:383] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.442281 21365 raft_consensus.cc:738] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.442991 21365 consensus_queue.cc:260] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.443936 21366 raft_consensus.cc:357] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.444200 21364 raft_consensus.cc:357] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.444571 21366 raft_consensus.cc:383] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.444782 21364 raft_consensus.cc:383] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.444820 21366 raft_consensus.cc:738] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.445111 21364 raft_consensus.cc:738] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.445468 21366 consensus_queue.cc:260] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.445717 21364 consensus_queue.cc:260] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.447175 21365 ts_tablet_manager.cc:1428] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:07.447976 21365 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:07.448024 21364 ts_tablet_manager.cc:1428] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:07.448848 21364 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:07.451697 21366 ts_tablet_manager.cc:1428] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20250109 21:10:07.452527 21366 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:07.453758 21365 tablet_bootstrap.cc:654] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.457742 21364 tablet_bootstrap.cc:654] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.468640 21366 tablet_bootstrap.cc:654] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.477212 21364 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:07.477715 21364 ts_tablet_manager.cc:1397] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.029s user 0.018s sys 0.004s
I20250109 21:10:07.480692 21365 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.481107 21366 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:07.480764 21364 raft_consensus.cc:357] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.481216 21365 ts_tablet_manager.cc:1397] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.033s user 0.017s sys 0.005s
I20250109 21:10:07.481498 21366 ts_tablet_manager.cc:1397] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.029s user 0.013s sys 0.005s
I20250109 21:10:07.481570 21364 raft_consensus.cc:383] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.481932 21364 raft_consensus.cc:738] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.482625 21364 consensus_queue.cc:260] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.483829 21365 raft_consensus.cc:357] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.484483 21365 raft_consensus.cc:383] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.484764 21365 raft_consensus.cc:738] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.484915 21364 ts_tablet_manager.cc:1428] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20250109 21:10:07.484133 21366 raft_consensus.cc:357] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.485301 21366 raft_consensus.cc:383] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.485549 21366 raft_consensus.cc:738] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.485788 21364 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:07.486091 21366 consensus_queue.cc:260] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.486719 21365 consensus_queue.cc:260] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.489017 21365 ts_tablet_manager.cc:1428] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20250109 21:10:07.491109 21364 tablet_bootstrap.cc:654] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.492527 21395 raft_consensus.cc:491] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.493188 21365 tablet_bootstrap.cc:492] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:07.492962 21395 raft_consensus.cc:513] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.494817 21395 leader_election.cc:290] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.496788 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800dbae8cc64427c8e80cc1ac7b42769" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:07.497398 21247 raft_consensus.cc:2463] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:07.498499 21136 leader_election.cc:304] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:07.499452 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800dbae8cc64427c8e80cc1ac7b42769" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:07.500156 21365 tablet_bootstrap.cc:654] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.500526 21395 raft_consensus.cc:2798] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:07.500913 21395 raft_consensus.cc:491] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:07.501291 21395 raft_consensus.cc:3054] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.500077 21323 raft_consensus.cc:2463] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:07.492045 21366 ts_tablet_manager.cc:1428] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.010s user 0.002s sys 0.003s
I20250109 21:10:07.503247 21371 raft_consensus.cc:491] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.504195 21371 raft_consensus.cc:513] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.506537 21371 leader_election.cc:290] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.507422 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6a07c6bbe4fcbadfe6fe3c94f913a" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:07.508009 21323 raft_consensus.cc:2463] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:07.509261 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6a07c6bbe4fcbadfe6fe3c94f913a" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:07.510540 21214 leader_election.cc:304] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
W20250109 21:10:07.511677 21213 leader_election.cc:343] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.511808 21366 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:07.513013 21371 raft_consensus.cc:2798] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:07.513381 21371 raft_consensus.cc:491] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:07.513693 21371 raft_consensus.cc:3054] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.514439 21365 tablet_bootstrap.cc:492] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.514870 21365 ts_tablet_manager.cc:1397] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.005s
I20250109 21:10:07.517246 21365 raft_consensus.cc:357] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.517835 21365 raft_consensus.cc:383] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.518061 21365 raft_consensus.cc:738] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.519363 21366 tablet_bootstrap.cc:654] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.519114 21371 raft_consensus.cc:513] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.519425 21365 consensus_queue.cc:260] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.520907 21371 leader_election.cc:290] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.521704 21365 ts_tablet_manager.cc:1428] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.003s sys 0.000s
I20250109 21:10:07.522006 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6a07c6bbe4fcbadfe6fe3c94f913a" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:07.522420 21323 raft_consensus.cc:3054] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.523043 21365 tablet_bootstrap.cc:492] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:07.525370 21372 raft_consensus.cc:491] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.525946 21372 raft_consensus.cc:513] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.528247 21372 leader_election.cc:290] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.529539 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:07.530354 21247 raft_consensus.cc:2463] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:07.532533 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:07.533964 21136 leader_election.cc:304] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:07.536065 21372 raft_consensus.cc:2798] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:07.536469 21372 raft_consensus.cc:491] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:07.536885 21372 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:07.543256 21137 leader_election.cc:343] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.556422 21370 raft_consensus.cc:491] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.556854 21370 raft_consensus.cc:513] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.558665 21370 leader_election.cc:290] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:07.590837 21364 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:07.587203 21365 tablet_bootstrap.cc:654] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.585404 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703480173d7142d0b22a2ec903e1707d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:07.601200 21364 ts_tablet_manager.cc:1397] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.116s user 0.020s sys 0.034s
I20250109 21:10:07.558847 21372 raft_consensus.cc:513] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.560251 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "703480173d7142d0b22a2ec903e1707d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:07.603300 21288 leader_election.cc:304] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:07.604321 21370 raft_consensus.cc:2743] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:07.604614 21364 raft_consensus.cc:357] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.605446 21364 raft_consensus.cc:383] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.605782 21364 raft_consensus.cc:738] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.581458 21404 raft_consensus.cc:491] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.604097 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:07.606427 21404 raft_consensus.cc:513] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.607246 21247 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.607677 21364 consensus_queue.cc:260] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.609161 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa09aa7e53c4ba9a22836b10b7a8446" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:07.609848 21169 raft_consensus.cc:2463] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:07.610854 21288 leader_election.cc:304] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:07.611366 21364 ts_tablet_manager.cc:1428] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.010s user 0.006s sys 0.001s
I20250109 21:10:07.611742 21370 raft_consensus.cc:2798] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:07.612635 21370 raft_consensus.cc:491] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:07.613022 21370 raft_consensus.cc:3054] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.613193 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa09aa7e53c4ba9a22836b10b7a8446" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:07.613533 21364 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:07.613801 21246 raft_consensus.cc:2463] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:07.616794 21372 leader_election.cc:290] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.619285 21364 tablet_bootstrap.cc:654] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.598639 21395 raft_consensus.cc:513] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:07.587422 21137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 44211.6us
I20250109 21:10:07.621615 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:07.620059 21323 raft_consensus.cc:2463] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:07.623317 21214 leader_election.cc:304] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:07.624049 21371 raft_consensus.cc:2798] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:07.624480 21371 raft_consensus.cc:695] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:07.625000 21247 raft_consensus.cc:2463] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:07.612177 21404 leader_election.cc:290] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:07.626633 21370 raft_consensus.cc:513] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.629403 21366 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:07.629966 21366 ts_tablet_manager.cc:1397] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.118s user 0.010s sys 0.000s
I20250109 21:10:07.630234 21370 leader_election.cc:290] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:07.625229 21371 consensus_queue.cc:237] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.630120 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa09aa7e53c4ba9a22836b10b7a8446" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:07.631337 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa09aa7e53c4ba9a22836b10b7a8446" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:07.631757 21169 raft_consensus.cc:3054] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.632061 21246 raft_consensus.cc:3054] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.636262 21136 leader_election.cc:304] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
W20250109 21:10:07.656033 21137 leader_election.cc:343] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.656208 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "28f6a07c6bbe4fcbadfe6fe3c94f913a" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:07.656817 21168 raft_consensus.cc:3054] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.659663 21372 raft_consensus.cc:2798] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:07.660125 21372 raft_consensus.cc:695] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:07.660876 21372 consensus_queue.cc:237] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:07.661885 21214 consensus_peers.cc:487] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:07.665597 21247 raft_consensus.cc:3054] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.673702 21169 raft_consensus.cc:2463] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:07.674844 21288 leader_election.cc:304] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:07.675688 21370 raft_consensus.cc:2798] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:07.676327 21370 raft_consensus.cc:695] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:07.677155 21370 consensus_queue.cc:237] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.681833 21511 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:07.682662 21066 catalog_manager.cc:5526] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:07.687073 21366 raft_consensus.cc:357] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.690387 21366 raft_consensus.cc:383] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.691702 21366 raft_consensus.cc:738] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.643306 21416 raft_consensus.cc:491] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.693105 21366 consensus_queue.cc:260] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.696300 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800dbae8cc64427c8e80cc1ac7b42769" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:07.700850 21168 raft_consensus.cc:2463] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:07.697521 21416 raft_consensus.cc:513] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.704857 21416 leader_election.cc:290] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.703032 21246 raft_consensus.cc:2463] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:07.698043 21395 leader_election.cc:290] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.712337 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "800dbae8cc64427c8e80cc1ac7b42769" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:07.713068 21324 raft_consensus.cc:3054] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.719172 21366 ts_tablet_manager.cc:1428] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.085s user 0.008s sys 0.000s
I20250109 21:10:07.719127 21171 raft_consensus.cc:3054] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.720149 21366 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:07.726609 21511 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:07.726774 21416 consensus_queue.cc:1035] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:07.707836 21247 raft_consensus.cc:3054] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.732474 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7c70db395b4c95bdd3a519fbff09f1" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:07.735221 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6f7c70db395b4c95bdd3a519fbff09f1" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:07.769344 21365 tablet_bootstrap.cc:492] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.769475 21246 raft_consensus.cc:3054] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.769865 21365 ts_tablet_manager.cc:1397] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.247s user 0.047s sys 0.097s
I20250109 21:10:07.772913 21365 raft_consensus.cc:357] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.773581 21365 raft_consensus.cc:383] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.773826 21365 raft_consensus.cc:738] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.774386 21365 consensus_queue.cc:260] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.779868 21213 leader_election.cc:304] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
W20250109 21:10:07.785503 21136 consensus_peers.cc:487] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:07.774571 21066 catalog_manager.cc:5526] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:07.791302 21365 ts_tablet_manager.cc:1428] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.021s user 0.006s sys 0.002s
I20250109 21:10:07.791965 21365 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:07.793887 21364 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:07.794341 21364 ts_tablet_manager.cc:1397] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.181s user 0.015s sys 0.009s
I20250109 21:10:07.794488 21324 raft_consensus.cc:2463] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:07.797024 21364 raft_consensus.cc:357] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.797701 21364 raft_consensus.cc:383] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.797986 21364 raft_consensus.cc:738] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.798518 21364 consensus_queue.cc:260] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.797513 21069 catalog_manager.cc:5526] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:07.804718 21364 ts_tablet_manager.cc:1428] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250109 21:10:07.805552 21364 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:07.805706 21371 raft_consensus.cc:2743] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:07.806787 21137 leader_election.cc:304] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:07.808660 21395 raft_consensus.cc:2798] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:07.809142 21395 raft_consensus.cc:695] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:07.811332 21395 consensus_queue.cc:237] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.820992 21511 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:07.837318 21511 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250109 21:10:07.849802 21366 tablet_bootstrap.cc:654] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:07.852003 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:07.860519 21324 raft_consensus.cc:3054] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:07.861478 21371 raft_consensus.cc:491] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.862625 21432 raft_consensus.cc:491] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.867998 21371 raft_consensus.cc:513] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.872102 21432 raft_consensus.cc:513] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.874552 21371 leader_election.cc:290] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.876008 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:07.876410 21432 leader_election.cc:290] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:07.876942 21364 tablet_bootstrap.cc:654] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.877138 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
W20250109 21:10:07.891943 21213 leader_election.cc:343] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:07.892510 21214 leader_election.cc:343] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.899488 21214 leader_election.cc:304] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:07.900260 21247 raft_consensus.cc:2463] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:07.900635 21416 raft_consensus.cc:2743] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:07.903632 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a65a2d287ce4921be6fe0d816e85fd8" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:07.913699 21395 raft_consensus.cc:491] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:07.914325 21395 raft_consensus.cc:513] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.921904 21366 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:07.923512 21366 ts_tablet_manager.cc:1397] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.204s user 0.013s sys 0.004s
I20250109 21:10:07.921468 21069 catalog_manager.cc:5526] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:07.927883 21395 leader_election.cc:290] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:07.927467 21366 raft_consensus.cc:357] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.913158 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0a65a2d287ce4921be6fe0d816e85fd8" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:07.928488 21366 raft_consensus.cc:383] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.928922 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:07.929642 21366 raft_consensus.cc:738] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.930264 21366 consensus_queue.cc:260] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:07.931561 21136 leader_election.cc:343] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.932406 21366 ts_tablet_manager.cc:1428] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20250109 21:10:07.935833 21366 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:07.937716 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:07.939008 21288 leader_election.cc:304] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
W20250109 21:10:07.942857 21137 leader_election.cc:343] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:07.942986 21370 raft_consensus.cc:2743] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:07.943356 21137 leader_election.cc:304] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:07.943642 21365 tablet_bootstrap.cc:654] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.944424 21395 raft_consensus.cc:2743] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:07.947275 21364 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:07.947686 21364 ts_tablet_manager.cc:1397] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.142s user 0.009s sys 0.009s
I20250109 21:10:07.948091 21395 consensus_queue.cc:1035] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:07.950215 21364 raft_consensus.cc:357] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.950929 21364 raft_consensus.cc:383] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.951192 21364 raft_consensus.cc:738] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.951769 21364 consensus_queue.cc:260] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.964226 21364 ts_tablet_manager.cc:1428] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.016s user 0.006s sys 0.000s
I20250109 21:10:07.965593 21364 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:07.970011 21366 tablet_bootstrap.cc:654] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.980319 21364 tablet_bootstrap.cc:654] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:07.981256 21365 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:07.981703 21365 ts_tablet_manager.cc:1397] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.190s user 0.026s sys 0.010s
I20250109 21:10:07.984294 21365 raft_consensus.cc:357] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.984956 21365 raft_consensus.cc:383] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:07.985232 21365 raft_consensus.cc:738] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:07.985882 21365 consensus_queue.cc:260] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:07.995359 21365 ts_tablet_manager.cc:1428] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.013s user 0.007s sys 0.001s
I20250109 21:10:07.996560 21365 tablet_bootstrap.cc:492] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.005216 21365 tablet_bootstrap.cc:654] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.022087 21366 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.022488 21366 ts_tablet_manager.cc:1397] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.087s user 0.007s sys 0.006s
I20250109 21:10:08.024849 21366 raft_consensus.cc:357] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.025552 21366 raft_consensus.cc:383] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.025787 21366 raft_consensus.cc:738] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.026296 21366 consensus_queue.cc:260] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.028487 21366 ts_tablet_manager.cc:1428] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:10:08.029311 21366 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.032505 21365 tablet_bootstrap.cc:492] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.032938 21365 ts_tablet_manager.cc:1397] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.037s user 0.018s sys 0.012s
I20250109 21:10:08.034713 21366 tablet_bootstrap.cc:654] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.035215 21365 raft_consensus.cc:357] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.035768 21365 raft_consensus.cc:383] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.036041 21365 raft_consensus.cc:738] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.036612 21365 consensus_queue.cc:260] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.038292 21364 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.038672 21364 ts_tablet_manager.cc:1397] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.073s user 0.019s sys 0.014s
I20250109 21:10:08.038694 21365 ts_tablet_manager.cc:1428] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250109 21:10:08.039623 21365 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.040655 21364 raft_consensus.cc:357] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.041333 21364 raft_consensus.cc:383] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.041590 21364 raft_consensus.cc:738] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.042248 21364 consensus_queue.cc:260] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.043669 21416 consensus_queue.cc:1035] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:08.044382 21364 ts_tablet_manager.cc:1428] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20250109 21:10:08.045320 21364 tablet_bootstrap.cc:492] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.045536 21365 tablet_bootstrap.cc:654] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.047983 21454 raft_consensus.cc:491] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.048575 21454 raft_consensus.cc:513] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.052271 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2136d77ff941c8aee442e2c39c95bb" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.053077 21366 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.053481 21366 ts_tablet_manager.cc:1397] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.024s user 0.008s sys 0.000s
I20250109 21:10:08.055253 21323 raft_consensus.cc:3054] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:08.055586 21136 leader_election.cc:343] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.055961 21366 raft_consensus.cc:357] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.056638 21366 raft_consensus.cc:383] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.056890 21366 raft_consensus.cc:738] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.057938 21366 consensus_queue.cc:260] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.060163 21366 ts_tablet_manager.cc:1428] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250109 21:10:08.060048 21454 leader_election.cc:290] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.061101 21366 tablet_bootstrap.cc:492] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.063004 21364 tablet_bootstrap.cc:654] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.063961 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2136d77ff941c8aee442e2c39c95bb" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:08.065330 21137 leader_election.cc:343] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.065744 21137 leader_election.cc:304] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:08.068650 21372 raft_consensus.cc:2743] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.069430 21372 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:08.073544 21366 tablet_bootstrap.cc:654] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.076401 21364 tablet_bootstrap.cc:492] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.076949 21364 ts_tablet_manager.cc:1397] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.032s user 0.010s sys 0.002s
I20250109 21:10:08.082526 21364 raft_consensus.cc:357] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.083221 21364 raft_consensus.cc:383] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.083487 21364 raft_consensus.cc:738] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.084138 21370 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:08.084110 21364 consensus_queue.cc:260] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.088137 21364 ts_tablet_manager.cc:1428] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20250109 21:10:08.088531 21370 raft_consensus.cc:491] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.089020 21364 tablet_bootstrap.cc:492] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.088936 21370 raft_consensus.cc:513] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.090900 21370 leader_election.cc:290] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:08.092622 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80bbbef4a3bd4a8789ff1a631b7f36e4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.093289 21168 raft_consensus.cc:2463] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:08.094502 21288 leader_election.cc:304] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:08.094889 21364 tablet_bootstrap.cc:654] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.096395 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80bbbef4a3bd4a8789ff1a631b7f36e4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:08.105475 21288 leader_election.cc:343] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.096915 21370 raft_consensus.cc:2798] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.110414 21370 raft_consensus.cc:491] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.110814 21370 raft_consensus.cc:3054] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.139962 21473 consensus_queue.cc:1035] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:08.158236 21404 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:08.171593 21365 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.170837 21370 raft_consensus.cc:513] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.172609 21365 ts_tablet_manager.cc:1397] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.133s user 0.050s sys 0.078s
I20250109 21:10:08.175120 21365 raft_consensus.cc:357] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.175802 21365 raft_consensus.cc:383] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.176059 21365 raft_consensus.cc:738] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.176648 21365 consensus_queue.cc:260] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.178700 21365 ts_tablet_manager.cc:1428] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:08.180192 21365 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.180456 21364 tablet_bootstrap.cc:492] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.180737 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80bbbef4a3bd4a8789ff1a631b7f36e4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:08.181346 21171 raft_consensus.cc:3054] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.182766 21366 tablet_bootstrap.cc:492] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.183050 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80bbbef4a3bd4a8789ff1a631b7f36e4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:08.183303 21366 ts_tablet_manager.cc:1397] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.122s user 0.028s sys 0.031s
W20250109 21:10:08.184499 21288 leader_election.cc:343] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.180963 21364 ts_tablet_manager.cc:1397] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.092s user 0.016s sys 0.027s
I20250109 21:10:08.185401 21324 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.186069 21454 raft_consensus.cc:491] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.186614 21454 raft_consensus.cc:513] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.187247 21365 tablet_bootstrap.cc:654] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.188386 21454 leader_election.cc:290] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.189796 21473 raft_consensus.cc:491] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.190343 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.191656 21370 leader_election.cc:290] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:08.190388 21473 raft_consensus.cc:513] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.192934 21364 raft_consensus.cc:357] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.193620 21364 raft_consensus.cc:383] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.193885 21473 leader_election.cc:290] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.193879 21364 raft_consensus.cc:738] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.194893 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.195015 21364 consensus_queue.cc:260] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.195533 21170 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:08.195885 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.196616 21364 ts_tablet_manager.cc:1428] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.012s user 0.004s sys 0.000s
I20250109 21:10:08.196655 21246 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:08.197054 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.197579 21364 tablet_bootstrap.cc:492] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.198987 21213 leader_election.cc:304] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:08.199564 21136 leader_election.cc:304] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:08.200241 21371 raft_consensus.cc:2798] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.200642 21371 raft_consensus.cc:491] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.201010 21371 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.201133 21372 raft_consensus.cc:2798] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.201649 21372 raft_consensus.cc:491] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.202037 21372 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.190783 21366 raft_consensus.cc:357] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.203038 21366 raft_consensus.cc:383] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.203330 21366 raft_consensus.cc:738] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.203903 21366 consensus_queue.cc:260] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.206497 21366 ts_tablet_manager.cc:1428] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20250109 21:10:08.207106 21364 tablet_bootstrap.cc:654] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.211071 21473 raft_consensus.cc:491] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.211742 21473 raft_consensus.cc:513] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.215651 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa9778f2eb54207aea2f47f9037b443" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.216337 21473 leader_election.cc:290] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.217763 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa9778f2eb54207aea2f47f9037b443" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.218026 21364 tablet_bootstrap.cc:492] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.216342 21568 raft_consensus.cc:491] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.218482 21364 ts_tablet_manager.cc:1397] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.006s
I20250109 21:10:08.218611 21568 raft_consensus.cc:513] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:08.219120 21214 leader_election.cc:343] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:08.219895 21213 leader_election.cc:343] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.220350 21213 leader_election.cc:304] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:08.220606 21568 leader_election.cc:290] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.221071 21568 raft_consensus.cc:2743] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.220904 21364 raft_consensus.cc:357] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.221616 21364 raft_consensus.cc:383] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.221885 21364 raft_consensus.cc:738] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.222817 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c404ac7e616f4de9b6df5a2d9259a4b6" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.222615 21364 consensus_queue.cc:260] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.222645 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c404ac7e616f4de9b6df5a2d9259a4b6" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.224464 21364 ts_tablet_manager.cc:1428] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:10:08.225386 21364 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.229086 21213 leader_election.cc:304] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:08.230329 21568 raft_consensus.cc:2743] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.230999 21364 tablet_bootstrap.cc:654] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.235878 21323 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:08.235008 21371 raft_consensus.cc:513] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.241418 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:08.245419 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:08.245983 21323 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.249986 21394 raft_consensus.cc:491] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.250558 21394 raft_consensus.cc:513] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.253007 21394 leader_election.cc:290] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.254505 21366 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.255453 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:08.256937 21137 leader_election.cc:343] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.257759 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.260479 21366 tablet_bootstrap.cc:654] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.249284 21371 leader_election.cc:290] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.264811 21394 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:08.266767 21454 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:08.279645 21248 raft_consensus.cc:3054] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.280417 21366 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.280995 21366 ts_tablet_manager.cc:1397] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.027s user 0.012s sys 0.004s
I20250109 21:10:08.297137 21568 raft_consensus.cc:491] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.297785 21568 raft_consensus.cc:513] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.300565 21568 leader_election.cc:290] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.298444 21394 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20250109 21:10:08.303041 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:08.306499 21214 leader_election.cc:343] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:08.327898 21136 leader_election.cc:343] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.352058 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.352609 21136 leader_election.cc:304] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
W20250109 21:10:08.353287 21213 leader_election.cc:343] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.353753 21213 leader_election.cc:304] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:08.353978 21573 raft_consensus.cc:2743] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.355088 21366 raft_consensus.cc:357] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.355757 21366 raft_consensus.cc:383] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.356024 21366 raft_consensus.cc:738] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.356673 21366 consensus_queue.cc:260] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.358333 21364 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.360468 21364 ts_tablet_manager.cc:1397] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.135s user 0.023s sys 0.032s
I20250109 21:10:08.334249 21171 raft_consensus.cc:2463] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:08.351239 21323 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:08.363317 21214 leader_election.cc:304] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:08.363730 21366 ts_tablet_manager.cc:1428] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.082s user 0.008s sys 0.014s
I20250109 21:10:08.364154 21416 raft_consensus.cc:2798] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:08.364625 21366 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.364601 21416 raft_consensus.cc:695] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:08.364840 21288 leader_election.cc:304] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:08.365512 21416 consensus_queue.cc:237] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.366092 21432 raft_consensus.cc:2798] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:08.366688 21432 raft_consensus.cc:695] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:08.367259 21473 raft_consensus.cc:2743] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.367527 21432 consensus_queue.cc:237] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.368693 21364 raft_consensus.cc:357] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.369356 21364 raft_consensus.cc:383] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.369602 21364 raft_consensus.cc:738] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.370160 21364 consensus_queue.cc:260] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.372411 21364 ts_tablet_manager.cc:1428] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20250109 21:10:08.372720 21370 raft_consensus.cc:491] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.373243 21364 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.373128 21370 raft_consensus.cc:513] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.374881 21370 leader_election.cc:290] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
W20250109 21:10:08.385982 21136 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:44109, user_credentials={real_user=slave}} blocked reactor thread for 58131.3us
I20250109 21:10:08.388868 21372 raft_consensus.cc:513] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.396339 21167 raft_consensus.cc:2388] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5d1eaae36f84176860e3799d49e4f53 in current term 1: Already voted for candidate 1774487f18694af1a5340fc8486cff53 in this term.
I20250109 21:10:08.403725 21366 tablet_bootstrap.cc:654] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.409729 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.415367 21364 tablet_bootstrap.cc:654] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.416988 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.418640 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:08.420761 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:08.422049 21323 raft_consensus.cc:2388] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
W20250109 21:10:08.426425 21288 leader_election.cc:343] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.428949 21137 leader_election.cc:304] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:08.429924 21394 raft_consensus.cc:2743] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
W20250109 21:10:08.430550 21288 leader_election.cc:343] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.431011 21288 leader_election.cc:304] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:08.421461 21372 leader_election.cc:290] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.432407 21370 raft_consensus.cc:2743] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.427641 21365 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.434206 21365 ts_tablet_manager.cc:1397] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.254s user 0.054s sys 0.139s
I20250109 21:10:08.437130 21365 raft_consensus.cc:357] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.437572 21365 raft_consensus.cc:383] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.437721 21365 raft_consensus.cc:738] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.438176 21365 consensus_queue.cc:260] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.439644 21365 ts_tablet_manager.cc:1428] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250109 21:10:08.440419 21365 tablet_bootstrap.cc:492] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.447824 21365 tablet_bootstrap.cc:654] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.450053 21370 raft_consensus.cc:491] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.450490 21370 raft_consensus.cc:513] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.452086 21370 leader_election.cc:290] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:08.453449 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.454125 21169 raft_consensus.cc:2463] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:08.455752 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.456475 21288 leader_election.cc:304] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:08.457964 21370 raft_consensus.cc:2798] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.458328 21370 raft_consensus.cc:491] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.458673 21370 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.464073 21066 catalog_manager.cc:5526] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
W20250109 21:10:08.466760 21288 leader_election.cc:343] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.468415 21371 raft_consensus.cc:491] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.469009 21371 raft_consensus.cc:513] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.464924 21370 raft_consensus.cc:513] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.473037 21370 leader_election.cc:290] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:08.474403 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:08.475448 21169 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.475674 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:08.475540 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2136d77ff941c8aee442e2c39c95bb" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.476437 21168 raft_consensus.cc:2463] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:08.477829 21213 leader_election.cc:304] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:08.478670 21568 raft_consensus.cc:2798] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.479050 21568 raft_consensus.cc:491] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.479420 21568 raft_consensus.cc:3054] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.481608 21371 leader_election.cc:290] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.482563 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2136d77ff941c8aee442e2c39c95bb" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:08.484165 21214 leader_election.cc:343] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.485806 21169 raft_consensus.cc:2463] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:08.487641 21364 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.488144 21366 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.491357 21364 ts_tablet_manager.cc:1397] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.118s user 0.019s sys 0.021s
I20250109 21:10:08.491573 21366 ts_tablet_manager.cc:1397] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.127s user 0.018s sys 0.003s
W20250109 21:10:08.488456 21288 leader_election.cc:343] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.493770 21364 raft_consensus.cc:357] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.494488 21364 raft_consensus.cc:383] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.494762 21364 raft_consensus.cc:738] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.495126 21366 raft_consensus.cc:357] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.495371 21364 consensus_queue.cc:260] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.493996 21288 leader_election.cc:304] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters: f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:08.485841 21568 raft_consensus.cc:513] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.497565 21568 leader_election.cc:290] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.495779 21366 raft_consensus.cc:383] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.498061 21366 raft_consensus.cc:738] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.498200 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2136d77ff941c8aee442e2c39c95bb" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:08.490080 21365 tablet_bootstrap.cc:492] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.498541 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2136d77ff941c8aee442e2c39c95bb" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:08.502672 21067 catalog_manager.cc:5526] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:08.498800 21168 raft_consensus.cc:3054] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:08.504235 21214 leader_election.cc:343] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.499079 21365 ts_tablet_manager.cc:1397] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.059s user 0.028s sys 0.022s
I20250109 21:10:08.498693 21366 consensus_queue.cc:260] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.507194 21365 raft_consensus.cc:357] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.507862 21365 raft_consensus.cc:383] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.508124 21365 raft_consensus.cc:738] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.508708 21365 consensus_queue.cc:260] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.509277 21366 ts_tablet_manager.cc:1428] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.017s user 0.003s sys 0.002s
I20250109 21:10:08.510483 21366 tablet_bootstrap.cc:492] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.510725 21365 ts_tablet_manager.cc:1428] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20250109 21:10:08.511373 21168 raft_consensus.cc:2463] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:08.501219 21364 ts_tablet_manager.cc:1428] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250109 21:10:08.511549 21365 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.512493 21213 leader_election.cc:304] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:08.514595 21568 raft_consensus.cc:2798] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:08.515062 21568 raft_consensus.cc:695] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:08.515841 21568 consensus_queue.cc:237] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.516634 21366 tablet_bootstrap.cc:654] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.512488 21364 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.499567 21370 raft_consensus.cc:2798] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:08.518257 21370 raft_consensus.cc:695] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:08.519064 21370 consensus_queue.cc:237] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.526583 21366 tablet_bootstrap.cc:492] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.527055 21364 tablet_bootstrap.cc:654] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.527060 21366 ts_tablet_manager.cc:1397] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.017s user 0.015s sys 0.000s
I20250109 21:10:08.527738 21365 tablet_bootstrap.cc:654] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.529623 21366 raft_consensus.cc:357] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.530288 21366 raft_consensus.cc:383] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.530537 21366 raft_consensus.cc:738] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.531180 21366 consensus_queue.cc:260] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.533324 21366 ts_tablet_manager.cc:1428] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:10:08.534089 21366 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.538249 21364 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.538647 21364 ts_tablet_manager.cc:1397] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.026s user 0.008s sys 0.004s
I20250109 21:10:08.539325 21366 tablet_bootstrap.cc:654] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.541556 21371 raft_consensus.cc:491] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.542160 21371 raft_consensus.cc:513] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.545918 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80bbbef4a3bd4a8789ff1a631b7f36e4" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.549156 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "80bbbef4a3bd4a8789ff1a631b7f36e4" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.550160 21168 raft_consensus.cc:2388] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate f5d1eaae36f84176860e3799d49e4f53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:08.551533 21213 leader_election.cc:304] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:08.553014 21473 raft_consensus.cc:3054] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.560561 21371 leader_election.cc:290] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.567797 21473 raft_consensus.cc:2743] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.541591 21364 raft_consensus.cc:357] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.569818 21364 raft_consensus.cc:383] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.570170 21364 raft_consensus.cc:738] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.568486 21068 catalog_manager.cc:5526] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:08.571583 21364 consensus_queue.cc:260] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.573772 21365 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.574203 21365 ts_tablet_manager.cc:1397] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.063s user 0.010s sys 0.035s
I20250109 21:10:08.574239 21364 ts_tablet_manager.cc:1428] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.035s user 0.008s sys 0.000s
I20250109 21:10:08.577649 21364 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.576617 21365 raft_consensus.cc:357] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.580818 21365 raft_consensus.cc:383] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.581123 21365 raft_consensus.cc:738] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.581753 21365 consensus_queue.cc:260] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.584247 21365 ts_tablet_manager.cc:1428] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250109 21:10:08.584678 21364 tablet_bootstrap.cc:654] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.585078 21365 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.588552 21366 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.589031 21366 ts_tablet_manager.cc:1397] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.055s user 0.029s sys 0.017s
I20250109 21:10:08.591466 21366 raft_consensus.cc:357] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.595427 21366 raft_consensus.cc:383] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.595762 21366 raft_consensus.cc:738] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.596223 21364 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.596798 21364 ts_tablet_manager.cc:1397] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.019s user 0.006s sys 0.010s
I20250109 21:10:08.596488 21366 consensus_queue.cc:260] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.594326 21068 catalog_manager.cc:5526] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:08.599004 21366 ts_tablet_manager.cc:1428] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250109 21:10:08.592612 21365 tablet_bootstrap.cc:654] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.600018 21366 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.599018 21364 raft_consensus.cc:357] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.601933 21364 raft_consensus.cc:383] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.602196 21364 raft_consensus.cc:738] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.602769 21364 consensus_queue.cc:260] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.605057 21364 ts_tablet_manager.cc:1428] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.008s user 0.002s sys 0.003s
I20250109 21:10:08.605844 21364 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.611145 21364 tablet_bootstrap.cc:654] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.618558 21365 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.618991 21365 ts_tablet_manager.cc:1397] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.034s user 0.011s sys 0.011s
I20250109 21:10:08.619187 21364 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.619586 21364 ts_tablet_manager.cc:1397] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.014s user 0.005s sys 0.008s
I20250109 21:10:08.621224 21365 raft_consensus.cc:357] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.621908 21365 raft_consensus.cc:383] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.622308 21365 raft_consensus.cc:738] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.621843 21364 raft_consensus.cc:357] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.622766 21366 tablet_bootstrap.cc:654] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.622709 21364 raft_consensus.cc:383] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.623173 21364 raft_consensus.cc:738] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.622948 21365 consensus_queue.cc:260] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.623808 21364 consensus_queue.cc:260] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.624214 21454 raft_consensus.cc:491] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.624765 21454 raft_consensus.cc:513] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.626137 21364 ts_tablet_manager.cc:1428] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:10:08.626547 21454 leader_election.cc:290] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.627269 21364 tablet_bootstrap.cc:492] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.627297 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.627961 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.628103 21248 raft_consensus.cc:2463] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:08.629245 21136 leader_election.cc:304] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
W20250109 21:10:08.629963 21137 leader_election.cc:343] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.630772 21454 raft_consensus.cc:2798] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.631141 21454 raft_consensus.cc:491] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.631471 21454 raft_consensus.cc:3054] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.635046 21364 tablet_bootstrap.cc:654] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.636718 21365 ts_tablet_manager.cc:1428] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.017s user 0.004s sys 0.000s
I20250109 21:10:08.637712 21365 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.650571 21365 tablet_bootstrap.cc:654] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.700991 21454 raft_consensus.cc:513] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.705476 21364 tablet_bootstrap.cc:492] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.708909 21364 ts_tablet_manager.cc:1397] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.082s user 0.020s sys 0.044s
I20250109 21:10:08.705997 21365 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.710100 21365 ts_tablet_manager.cc:1397] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.073s user 0.023s sys 0.015s
I20250109 21:10:08.710862 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:08.711469 21248 raft_consensus.cc:3054] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.711727 21364 raft_consensus.cc:357] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.712402 21364 raft_consensus.cc:383] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.712658 21364 raft_consensus.cc:738] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.712777 21365 raft_consensus.cc:357] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.713429 21365 raft_consensus.cc:383] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.713249 21364 consensus_queue.cc:260] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.713681 21365 raft_consensus.cc:738] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.714334 21365 consensus_queue.cc:260] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.715466 21364 ts_tablet_manager.cc:1428] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:10:08.716805 21248 raft_consensus.cc:2463] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:08.716989 21365 ts_tablet_manager.cc:1428] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:08.708312 21366 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.717665 21366 ts_tablet_manager.cc:1397] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.118s user 0.028s sys 0.052s
I20250109 21:10:08.717998 21364 tablet_bootstrap.cc:492] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.717852 21136 leader_election.cc:304] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:08.718680 21394 raft_consensus.cc:2798] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:08.719143 21394 raft_consensus.cc:695] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:08.719858 21394 consensus_queue.cc:237] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.720948 21454 leader_election.cc:290] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.723752 21364 tablet_bootstrap.cc:654] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.720024 21366 raft_consensus.cc:357] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.724356 21366 raft_consensus.cc:383] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.724663 21366 raft_consensus.cc:738] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.725247 21366 consensus_queue.cc:260] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.727412 21366 ts_tablet_manager.cc:1428] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250109 21:10:08.732375 21366 tablet_bootstrap.cc:492] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.724023 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
W20250109 21:10:08.740144 21137 leader_election.cc:343] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.741214 21365 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.741379 21364 tablet_bootstrap.cc:492] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.741901 21364 ts_tablet_manager.cc:1397] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.009s
I20250109 21:10:08.742144 21568 raft_consensus.cc:491] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.743264 21366 tablet_bootstrap.cc:654] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.742565 21568 raft_consensus.cc:513] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.744892 21364 raft_consensus.cc:357] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.745626 21364 raft_consensus.cc:383] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.745927 21568 leader_election.cc:290] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.745934 21364 raft_consensus.cc:738] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.747174 21365 tablet_bootstrap.cc:654] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.746925 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.746959 21364 consensus_queue.cc:260] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.747781 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
W20250109 21:10:08.748232 21214 leader_election.cc:343] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.748579 21168 raft_consensus.cc:2463] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:08.749450 21364 ts_tablet_manager.cc:1428] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:08.750308 21364 tablet_bootstrap.cc:492] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.753921 21213 leader_election.cc:304] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:08.756182 21568 raft_consensus.cc:2798] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.756527 21568 raft_consensus.cc:491] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.756829 21568 raft_consensus.cc:3054] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.762516 21370 raft_consensus.cc:491] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.762964 21370 raft_consensus.cc:513] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.764230 21568 raft_consensus.cc:513] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.764617 21370 leader_election.cc:290] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:08.766892 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
W20250109 21:10:08.768222 21214 leader_election.cc:343] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.769721 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2136d77ff941c8aee442e2c39c95bb" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.770923 21568 leader_election.cc:290] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.772384 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fc2136d77ff941c8aee442e2c39c95bb" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.773038 21364 tablet_bootstrap.cc:654] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.773422 21168 raft_consensus.cc:2388] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0175ef2fbd0349568ba2bf83788476ea in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
I20250109 21:10:08.777616 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:08.778384 21167 raft_consensus.cc:3054] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.783972 21288 leader_election.cc:304] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:08.785944 21365 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.786572 21365 ts_tablet_manager.cc:1397] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.046s user 0.010s sys 0.005s
I20250109 21:10:08.787101 21568 consensus_queue.cc:1035] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:08.786049 21432 raft_consensus.cc:3054] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.802732 21568 consensus_queue.cc:1035] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:08.805176 21365 raft_consensus.cc:357] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.806084 21365 raft_consensus.cc:383] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.806414 21365 raft_consensus.cc:738] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.808876 21365 consensus_queue.cc:260] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.811193 21365 ts_tablet_manager.cc:1428] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.024s user 0.009s sys 0.000s
I20250109 21:10:08.811970 21365 tablet_bootstrap.cc:492] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.817677 21366 tablet_bootstrap.cc:492] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.818132 21366 ts_tablet_manager.cc:1397] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.086s user 0.050s sys 0.016s
I20250109 21:10:08.819269 21365 tablet_bootstrap.cc:654] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.820572 21366 raft_consensus.cc:357] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.821273 21366 raft_consensus.cc:383] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.821545 21366 raft_consensus.cc:738] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.822152 21366 consensus_queue.cc:260] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.823851 21394 raft_consensus.cc:491] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.824362 21394 raft_consensus.cc:513] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.825100 21366 ts_tablet_manager.cc:1428] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20250109 21:10:08.826373 21394 leader_election.cc:290] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.826850 21364 tablet_bootstrap.cc:492] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.827081 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41937a55ec6c4990b362365d82685977" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:08.828341 21136 leader_election.cc:343] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.828835 21366 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.828889 21066 catalog_manager.cc:5526] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:08.827322 21364 ts_tablet_manager.cc:1397] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.077s user 0.014s sys 0.016s
I20250109 21:10:08.832737 21365 tablet_bootstrap.cc:492] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.833138 21365 ts_tablet_manager.cc:1397] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.021s user 0.009s sys 0.006s
I20250109 21:10:08.833918 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41937a55ec6c4990b362365d82685977" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.834005 21364 raft_consensus.cc:357] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.834800 21364 raft_consensus.cc:383] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.835103 21364 raft_consensus.cc:738] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.835386 21365 raft_consensus.cc:357] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:08.835798 21137 leader_election.cc:343] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.836055 21365 raft_consensus.cc:383] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.836417 21137 leader_election.cc:304] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:08.836366 21365 raft_consensus.cc:738] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.838011 21365 consensus_queue.cc:260] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.839274 21366 tablet_bootstrap.cc:654] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.839172 21573 raft_consensus.cc:2743] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.835690 21364 consensus_queue.cc:260] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.845762 21365 ts_tablet_manager.cc:1428] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.012s user 0.004s sys 0.004s
I20250109 21:10:08.846619 21365 tablet_bootstrap.cc:492] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.847293 21432 raft_consensus.cc:2743] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:08.847836 21432 raft_consensus.cc:491] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.850546 21364 ts_tablet_manager.cc:1428] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.019s user 0.005s sys 0.000s
I20250109 21:10:08.850623 21167 raft_consensus.cc:2463] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:08.852258 21365 tablet_bootstrap.cc:654] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.852372 21213 leader_election.cc:304] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:08.848238 21432 raft_consensus.cc:513] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.853134 21371 raft_consensus.cc:2798] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:08.853623 21371 raft_consensus.cc:695] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:08.854323 21432 leader_election.cc:290] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:08.854426 21371 consensus_queue.cc:237] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.855265 21364 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:08.856567 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.857249 21248 raft_consensus.cc:2463] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:08.858958 21288 leader_election.cc:304] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:08.859694 21432 raft_consensus.cc:2798] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.860044 21432 raft_consensus.cc:491] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.860358 21432 raft_consensus.cc:3054] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.865142 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.865937 21167 raft_consensus.cc:2463] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:08.882884 21364 tablet_bootstrap.cc:654] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.888906 21366 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:08.889384 21366 ts_tablet_manager.cc:1397] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.063s user 0.018s sys 0.007s
I20250109 21:10:08.866509 21432 raft_consensus.cc:513] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.900913 21511 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:08.909762 21372 raft_consensus.cc:491] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.910008 21365 tablet_bootstrap.cc:492] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:08.910481 21365 ts_tablet_manager.cc:1397] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.064s user 0.006s sys 0.021s
I20250109 21:10:08.910250 21372 raft_consensus.cc:513] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.911568 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:08.912338 21243 raft_consensus.cc:3054] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.912796 21372 leader_election.cc:290] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.913832 21365 raft_consensus.cc:357] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.914535 21365 raft_consensus.cc:383] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.914779 21365 raft_consensus.cc:738] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.915144 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61283e0a72e04a589880431a717f04f3" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.915346 21365 consensus_queue.cc:260] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.915709 21244 raft_consensus.cc:2463] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:08.917057 21136 leader_election.cc:304] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:08.917500 21365 ts_tablet_manager.cc:1428] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20250109 21:10:08.918350 21365 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:08.918057 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61283e0a72e04a589880431a717f04f3" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.910543 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:08.919250 21167 raft_consensus.cc:3054] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.918018 21394 raft_consensus.cc:2798] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.925103 21066 catalog_manager.cc:5526] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:08.909766 21432 leader_election.cc:290] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:08.927179 21394 raft_consensus.cc:491] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.928402 21394 raft_consensus.cc:3054] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.932137 21573 raft_consensus.cc:491] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.932574 21573 raft_consensus.cc:513] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.934851 21573 leader_election.cc:290] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.936125 21372 raft_consensus.cc:491] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.937510 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfae02cdbdc49daa617467659ffaed6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.937726 21372 raft_consensus.cc:513] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.938550 21364 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:08.939162 21364 ts_tablet_manager.cc:1397] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.084s user 0.013s sys 0.017s
W20250109 21:10:08.938582 21137 leader_election.cc:343] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:08.941774 21365 tablet_bootstrap.cc:654] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:08.943827 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfae02cdbdc49daa617467659ffaed6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.944422 21244 raft_consensus.cc:2463] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:08.945354 21364 raft_consensus.cc:357] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.946031 21364 raft_consensus.cc:383] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:08.946305 21364 raft_consensus.cc:738] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:08.947691 21372 leader_election.cc:290] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.946051 21136 leader_election.cc:304] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:08.947306 21364 consensus_queue.cc:260] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.948211 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa9778f2eb54207aea2f47f9037b443" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.948802 21322 raft_consensus.cc:2463] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:08.949713 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa9778f2eb54207aea2f47f9037b443" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:08.949826 21137 leader_election.cc:304] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:08.950345 21247 raft_consensus.cc:2463] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:08.950541 21394 raft_consensus.cc:513] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.951198 21454 raft_consensus.cc:2798] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.951534 21454 raft_consensus.cc:491] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.951864 21454 raft_consensus.cc:3054] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.953132 21243 raft_consensus.cc:2463] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:08.953919 21372 raft_consensus.cc:2798] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:08.954265 21372 raft_consensus.cc:491] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:08.954594 21372 raft_consensus.cc:3054] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:08.954692 21371 raft_consensus.cc:491] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.955227 21371 raft_consensus.cc:513] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.956997 21371 leader_election.cc:290] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:08.958338 21167 raft_consensus.cc:2463] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:08.961927 21288 leader_election.cc:304] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:08.962741 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:08.963397 21323 raft_consensus.cc:2463] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:08.964632 21404 raft_consensus.cc:2798] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:08.970860 21366 raft_consensus.cc:357] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.015324 21370 raft_consensus.cc:491] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.015664 21366 raft_consensus.cc:383] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.016033 21366 raft_consensus.cc:738] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.015946 21370 raft_consensus.cc:513] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.016808 21366 consensus_queue.cc:260] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.020273 21370 leader_election.cc:290] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:09.021706 21364 ts_tablet_manager.cc:1428] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.082s user 0.000s sys 0.006s
I20250109 21:10:09.022388 21364 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:09.011399 21473 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:09.006243 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
W20250109 21:10:08.964866 21137 leader_election.cc:343] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.024585 21473 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:08.965380 21394 leader_election.cc:290] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.003786 21573 raft_consensus.cc:491] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:08.971616 21416 raft_consensus.cc:491] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:09.025848 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:44109, user_credentials={real_user=slave}} blocked reactor thread for 63988.9us
I20250109 21:10:09.011821 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61283e0a72e04a589880431a717f04f3" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:08.971817 21404 raft_consensus.cc:695] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:09.006760 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:08.979480 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61283e0a72e04a589880431a717f04f3" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.032888 21366 ts_tablet_manager.cc:1428] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.143s user 0.011s sys 0.012s
I20250109 21:10:09.033682 21366 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:08.964634 21214 leader_election.cc:304] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.033213 21322 raft_consensus.cc:3054] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.044061 21454 raft_consensus.cc:513] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.027750 21573 raft_consensus.cc:513] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.045907 21454 leader_election.cc:290] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.046197 21573 leader_election.cc:290] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.047260 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f91268c8384e79a83979ffd1c00d99" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:09.031857 21243 raft_consensus.cc:3054] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:09.050830 21288 leader_election.cc:343] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.051818 21371 raft_consensus.cc:491] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.052260 21371 raft_consensus.cc:513] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.048777 21568 raft_consensus.cc:2798] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:09.049160 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f91268c8384e79a83979ffd1c00d99" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
W20250109 21:10:09.028048 21137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 63204.4us
W20250109 21:10:09.049479 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 84924.2us
I20250109 21:10:09.057461 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:09.057789 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfae02cdbdc49daa617467659ffaed6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:09.050487 21167 raft_consensus.cc:2463] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:09.058344 21248 raft_consensus.cc:3054] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.054625 21371 leader_election.cc:290] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.054996 21568 raft_consensus.cc:491] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:09.058743 21473 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.058992 21568 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.043222 21372 raft_consensus.cc:513] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.060252 21364 tablet_bootstrap.cc:654] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.029994 21416 raft_consensus.cc:513] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.061534 21573 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.062044 21573 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.065642 21416 leader_election.cc:290] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.066355 21568 raft_consensus.cc:513] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.081115 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa9778f2eb54207aea2f47f9037b443" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:09.081708 21247 raft_consensus.cc:3054] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.081772 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:09.082456 21246 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:09.082880 21244 raft_consensus.cc:2388] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
I20250109 21:10:09.105717 21370 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:09.110533 21365 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:09.107764 21404 consensus_queue.cc:237] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.103861 21432 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.146294 21243 raft_consensus.cc:2463] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:09.121980 21372 leader_election.cc:290] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.136993 21573 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.155366 21432 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.161906 21432 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:09.164014 21243 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.164242 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:09.170360 21322 raft_consensus.cc:2463] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:09.181286 21136 leader_election.cc:304] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.183393 21573 raft_consensus.cc:2798] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:09.183876 21573 raft_consensus.cc:695] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:09.180269 21248 raft_consensus.cc:2463] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:09.184743 21573 consensus_queue.cc:237] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.185003 21365 ts_tablet_manager.cc:1397] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.267s user 0.019s sys 0.011s
I20250109 21:10:09.198364 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.202508 21416 consensus_queue.cc:1035] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250109 21:10:09.205895 21288 leader_election.cc:343] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.206882 21288 leader_election.cc:304] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:09.206969 21365 raft_consensus.cc:357] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.207854 21365 raft_consensus.cc:383] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.208177 21365 raft_consensus.cc:738] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.208853 21365 consensus_queue.cc:260] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.244740 21365 ts_tablet_manager.cc:1428] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.055s user 0.005s sys 0.001s
I20250109 21:10:09.221644 21136 leader_election.cc:304] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
W20250109 21:10:09.256106 21136 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:44109, user_credentials={real_user=slave}} blocked reactor thread for 47173.4us
I20250109 21:10:09.256876 21394 raft_consensus.cc:2798] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:09.259631 21365 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:09.184206 21247 raft_consensus.cc:2463] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:09.209988 21366 tablet_bootstrap.cc:654] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.209671 21432 raft_consensus.cc:2743] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:09.221354 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:09.244920 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:09.272048 21066 catalog_manager.cc:5526] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:09.261960 21416 raft_consensus.cc:491] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.208739 21568 leader_election.cc:290] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.210217 21244 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:09.209511 21404 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.067s
I20250109 21:10:09.297806 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.301172 21324 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:09.206480 21613 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.066s
I20250109 21:10:09.278051 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:09.300508 21394 raft_consensus.cc:695] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:09.286249 21416 raft_consensus.cc:513] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.304904 21167 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
W20250109 21:10:09.307747 21136 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:44109, user_credentials={real_user=slave}} blocked reactor thread for 50553.8us
I20250109 21:10:09.315825 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:09.316448 21166 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.313949 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e21bd94dd8648d09b26343df6230d65" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.320504 21416 leader_election.cc:290] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.321527 21288 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:09.312390 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e21bd94dd8648d09b26343df6230d65" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:09.330503 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfae02cdbdc49daa617467659ffaed6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.330897 21324 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.332222 21324 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.332484 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41937a55ec6c4990b362365d82685977" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:09.333109 21171 raft_consensus.cc:2463] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:09.327037 21432 raft_consensus.cc:2798] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:09.336422 21432 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:09.337409 21432 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.338732 21364 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:09.339216 21364 ts_tablet_manager.cc:1397] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.317s user 0.013s sys 0.038s
I20250109 21:10:09.340369 21365 tablet_bootstrap.cc:654] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.341176 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.341579 21364 raft_consensus.cc:357] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.342227 21364 raft_consensus.cc:383] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.335723 21165 raft_consensus.cc:2463] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:09.342535 21364 raft_consensus.cc:738] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.343302 21364 consensus_queue.cc:260] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.350003 21364 ts_tablet_manager.cc:1428] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250109 21:10:09.351111 21364 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:09.352303 21213 leader_election.cc:304] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.353091 21473 raft_consensus.cc:2798] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:09.330039 21136 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.357049 21069 catalog_manager.cc:5526] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:09.364496 21372 raft_consensus.cc:2798] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:09.364840 21372 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:09.365140 21372 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.364532 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.359411 21473 raft_consensus.cc:491] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:09.362040 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9fa9778f2eb54207aea2f47f9037b443" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.346091 21394 consensus_queue.cc:237] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.368849 21473 raft_consensus.cc:3054] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.374436 21166 raft_consensus.cc:2463] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:09.380846 21364 tablet_bootstrap.cc:654] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.366947 21136 leader_election.cc:304] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.375250 21321 raft_consensus.cc:3054] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.389180 21214 leader_election.cc:304] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:09.397163 21473 raft_consensus.cc:513] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.399557 21473 leader_election.cc:290] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.407856 21620 raft_consensus.cc:2798] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:09.408350 21620 raft_consensus.cc:695] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:09.409154 21620 consensus_queue.cc:237] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.410125 21372 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.417233 21366 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:09.423914 21366 ts_tablet_manager.cc:1397] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.390s user 0.015s sys 0.057s
I20250109 21:10:09.399951 21321 raft_consensus.cc:2463] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:09.442445 21364 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:09.443230 21364 ts_tablet_manager.cc:1397] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.093s user 0.011s sys 0.032s
I20250109 21:10:09.411247 21214 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:09.441057 21371 raft_consensus.cc:2743] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:09.460014 21614 raft_consensus.cc:2798] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250109 21:10:09.463351 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 58860.7us
I20250109 21:10:09.467564 21366 raft_consensus.cc:357] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.460398 21614 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:09.473011 21366 raft_consensus.cc:383] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.484021 21366 raft_consensus.cc:738] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.484906 21366 consensus_queue.cc:260] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.463212 21213 leader_election.cc:304] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.485966 21614 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:09.486490 21214 leader_election.cc:343] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.499370 21473 raft_consensus.cc:2798] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:09.533221 21366 ts_tablet_manager.cc:1428] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.109s user 0.007s sys 0.002s
I20250109 21:10:09.507153 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:09.466778 21324 raft_consensus.cc:2463] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:09.531111 21364 raft_consensus.cc:357] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.540138 21364 raft_consensus.cc:383] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.540429 21364 raft_consensus.cc:738] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.488605 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41937a55ec6c4990b362365d82685977" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:09.535076 21366 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
W20250109 21:10:09.541704 21629 log.cc:926] Time spent T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20250109 21:10:09.543291 21323 raft_consensus.cc:3054] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.490257 21372 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.461180 21432 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.534431 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41937a55ec6c4990b362365d82685977" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.500820 21213 leader_election.cc:304] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.537667 21365 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:09.541707 21364 consensus_queue.cc:260] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.545341 21365 ts_tablet_manager.cc:1397] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.286s user 0.011s sys 0.010s
I20250109 21:10:09.547780 21320 raft_consensus.cc:2388] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:09.548326 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "41937a55ec6c4990b362365d82685977" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.546489 21165 raft_consensus.cc:3054] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.497313 21137 leader_election.cc:304] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:09.548442 21432 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:09.534543 21473 raft_consensus.cc:491] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:09.555876 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:09.557113 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:09.557861 21171 raft_consensus.cc:2388] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0175ef2fbd0349568ba2bf83788476ea in current term 1: Already voted for candidate 1774487f18694af1a5340fc8486cff53 in this term.
W20250109 21:10:09.558928 21137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 61674.5us
W20250109 21:10:09.559597 21137 leader_election.cc:343] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.560037 21371 raft_consensus.cc:2798] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:09.560497 21371 raft_consensus.cc:695] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:09.560796 21454 raft_consensus.cc:2743] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:09.564388 21288 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
W20250109 21:10:09.561149 21213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 60405.8us
I20250109 21:10:09.566437 21404 raft_consensus.cc:2743] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:09.566327 21371 consensus_queue.cc:237] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.574038 21364 ts_tablet_manager.cc:1428] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.130s user 0.006s sys 0.001s
I20250109 21:10:09.561328 21473 raft_consensus.cc:3054] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.574898 21364 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:09.565268 21573 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
W20250109 21:10:09.578469 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 109128us
I20250109 21:10:09.580690 21621 consensus_queue.cc:1035] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20250109 21:10:09.586994 21626 log.cc:926] Time spent T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: Append to log took a long time: real 0.086s user 0.001s sys 0.000s
W20250109 21:10:09.591169 21214 consensus_peers.cc:487] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:09.594674 21622 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
W20250109 21:10:09.595860 21214 leader_election.cc:343] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:09.596693 21214 leader_election.cc:343] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.598717 21416 raft_consensus.cc:491] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.599130 21416 raft_consensus.cc:513] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.600795 21416 leader_election.cc:290] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.603751 21366 tablet_bootstrap.cc:654] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.608017 21632 raft_consensus.cc:491] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.619271 21365 raft_consensus.cc:357] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.619874 21365 raft_consensus.cc:383] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.620157 21365 raft_consensus.cc:738] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.620738 21365 consensus_queue.cc:260] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.623162 21365 ts_tablet_manager.cc:1428] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.078s user 0.004s sys 0.003s
I20250109 21:10:09.624001 21365 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:09.623796 21614 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.624977 21066 catalog_manager.cc:5526] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:09.608466 21632 raft_consensus.cc:513] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.635231 21248 raft_consensus.cc:2388] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
I20250109 21:10:09.640883 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d059ec48cb46dfac04405794b984ee" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.645733 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.646617 21323 raft_consensus.cc:2388] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:09.646307 21473 raft_consensus.cc:513] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.652032 21632 leader_election.cc:290] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:09.653934 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:09.655530 21473 leader_election.cc:290] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.655195 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:09.657061 21214 leader_election.cc:343] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.658011 21614 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.660856 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.661058 21454 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:09.661787 21320 raft_consensus.cc:2388] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5d1eaae36f84176860e3799d49e4f53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:09.662596 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e21bd94dd8648d09b26343df6230d65" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.662679 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d059ec48cb46dfac04405794b984ee" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:09.664861 21288 leader_election.cc:304] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:09.666761 21611 raft_consensus.cc:2743] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250109 21:10:09.668385 21214 leader_election.cc:343] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.674198 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e21bd94dd8648d09b26343df6230d65" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:09.674898 21168 raft_consensus.cc:3054] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.669360 21069 catalog_manager.cc:5526] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:09.665143 21165 raft_consensus.cc:2463] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:09.680191 21432 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:09.685562 21366 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:09.685987 21366 ts_tablet_manager.cc:1397] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.151s user 0.009s sys 0.008s
I20250109 21:10:09.688315 21366 raft_consensus.cc:357] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.688913 21366 raft_consensus.cc:383] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.689158 21366 raft_consensus.cc:738] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.689612 21366 consensus_queue.cc:260] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.691679 21168 raft_consensus.cc:2463] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:09.696955 21364 tablet_bootstrap.cc:654] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.697551 21432 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:09.704614 21366 ts_tablet_manager.cc:1428] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.018s user 0.006s sys 0.001s
I20250109 21:10:09.705768 21366 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:09.714275 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:09.720221 21167 raft_consensus.cc:2388] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate f5d1eaae36f84176860e3799d49e4f53 in current term 1: Already voted for candidate 1774487f18694af1a5340fc8486cff53 in this term.
W20250109 21:10:09.721009 21213 leader_election.cc:343] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.721625 21213 leader_election.cc:304] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:09.722530 21473 raft_consensus.cc:2743] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:09.727785 21068 catalog_manager.cc:5526] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:09.739399 21365 tablet_bootstrap.cc:654] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.746502 21137 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:09.747964 21454 raft_consensus.cc:2743] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:09.754953 21364 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:09.755455 21364 ts_tablet_manager.cc:1397] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.181s user 0.012s sys 0.022s
I20250109 21:10:09.760183 21213 leader_election.cc:304] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:09.761183 21473 raft_consensus.cc:2798] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:09.761637 21473 raft_consensus.cc:695] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:09.762403 21473 consensus_queue.cc:237] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.769109 21364 raft_consensus.cc:357] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.769690 21364 raft_consensus.cc:383] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.769799 21213 leader_election.cc:304] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:09.770953 21614 raft_consensus.cc:2798] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:09.771486 21614 raft_consensus.cc:695] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:09.769960 21364 raft_consensus.cc:738] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.772291 21614 consensus_queue.cc:237] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.772581 21364 consensus_queue.cc:260] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.773708 21366 tablet_bootstrap.cc:654] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.771700 21213 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:09.776935 21622 raft_consensus.cc:2743] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:09.782299 21364 ts_tablet_manager.cc:1428] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.027s user 0.004s sys 0.002s
I20250109 21:10:09.783164 21364 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:09.788265 21066 catalog_manager.cc:5526] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:09.792456 21634 raft_consensus.cc:491] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.792905 21634 raft_consensus.cc:513] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.795353 21454 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:09.795503 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963062e448e46b3b27c83dd6c77b956" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:09.796094 21248 raft_consensus.cc:2463] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:09.797199 21136 leader_election.cc:304] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.798297 21634 leader_election.cc:290] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.798344 21619 raft_consensus.cc:2798] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:09.799470 21619 raft_consensus.cc:491] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:09.799782 21619 raft_consensus.cc:3054] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.808593 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963062e448e46b3b27c83dd6c77b956" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.812462 21365 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:09.811792 21068 catalog_manager.cc:5526] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:09.813674 21365 ts_tablet_manager.cc:1397] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.190s user 0.008s sys 0.010s
I20250109 21:10:09.816092 21365 raft_consensus.cc:357] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.816731 21365 raft_consensus.cc:383] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.817003 21365 raft_consensus.cc:738] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.822966 21573 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:09.817576 21365 consensus_queue.cc:260] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.827780 21365 ts_tablet_manager.cc:1428] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20250109 21:10:09.828599 21365 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
W20250109 21:10:09.823247 21137 leader_election.cc:343] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.837739 21364 tablet_bootstrap.cc:654] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.843279 21619 raft_consensus.cc:513] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.849207 21366 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:09.849546 21366 ts_tablet_manager.cc:1397] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.144s user 0.013s sys 0.012s
I20250109 21:10:09.856946 21366 raft_consensus.cc:357] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.857326 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963062e448e46b3b27c83dd6c77b956" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:09.857599 21366 raft_consensus.cc:383] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.857869 21366 raft_consensus.cc:738] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.857906 21244 raft_consensus.cc:3054] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.858551 21366 consensus_queue.cc:260] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.864203 21366 ts_tablet_manager.cc:1428] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.014s user 0.007s sys 0.001s
I20250109 21:10:09.864995 21366 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:09.877616 21244 raft_consensus.cc:2463] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:09.879405 21136 leader_election.cc:304] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:09.880169 21372 raft_consensus.cc:2798] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:09.880623 21372 raft_consensus.cc:695] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:09.881639 21372 consensus_queue.cc:237] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.884860 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963062e448e46b3b27c83dd6c77b956" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:09.882918 21365 tablet_bootstrap.cc:654] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.882217 21619 leader_election.cc:290] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
W20250109 21:10:09.888588 21137 leader_election.cc:343] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:09.893584 21366 tablet_bootstrap.cc:654] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.895213 21364 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:09.895695 21364 ts_tablet_manager.cc:1397] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.113s user 0.012s sys 0.019s
I20250109 21:10:09.897933 21364 raft_consensus.cc:357] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.898633 21364 raft_consensus.cc:383] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.898958 21364 raft_consensus.cc:738] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.902318 21364 consensus_queue.cc:260] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.904501 21364 ts_tablet_manager.cc:1428] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20250109 21:10:09.905301 21364 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:09.907713 21634 consensus_queue.cc:1035] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:09.911445 21364 tablet_bootstrap.cc:654] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.915086 21573 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:09.926890 21069 catalog_manager.cc:5526] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:09.941181 21364 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:09.941674 21364 ts_tablet_manager.cc:1397] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.037s user 0.007s sys 0.008s
I20250109 21:10:09.944139 21364 raft_consensus.cc:357] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.944782 21364 raft_consensus.cc:383] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.945060 21364 raft_consensus.cc:738] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.945631 21364 consensus_queue.cc:260] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.946605 21573 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:09.947814 21364 ts_tablet_manager.cc:1428] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:09.948685 21364 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:09.954903 21364 tablet_bootstrap.cc:654] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.971577 21364 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
W20250109 21:10:09.971740 21137 consensus_peers.cc:487] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:09.972137 21364 ts_tablet_manager.cc:1397] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.006s
I20250109 21:10:09.973979 21634 raft_consensus.cc:491] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:09.974392 21634 raft_consensus.cc:513] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.974745 21364 raft_consensus.cc:357] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.975497 21364 raft_consensus.cc:383] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.975811 21364 raft_consensus.cc:738] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.976210 21634 leader_election.cc:290] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:09.976473 21364 consensus_queue.cc:260] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.977946 21366 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:09.978341 21366 ts_tablet_manager.cc:1397] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.114s user 0.037s sys 0.020s
I20250109 21:10:09.978891 21364 ts_tablet_manager.cc:1428] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.006s user 0.004s sys 0.001s
I20250109 21:10:09.979050 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f91268c8384e79a83979ffd1c00d99" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:09.979590 21323 raft_consensus.cc:2463] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:09.979852 21364 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:09.980650 21137 leader_election.cc:304] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:09.980543 21366 raft_consensus.cc:357] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.981314 21366 raft_consensus.cc:383] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:09.981580 21366 raft_consensus.cc:738] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:09.981703 21454 raft_consensus.cc:2798] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:09.982092 21454 raft_consensus.cc:491] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:09.982491 21454 raft_consensus.cc:3054] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:09.982161 21366 consensus_queue.cc:260] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:09.984328 21366 ts_tablet_manager.cc:1428] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20250109 21:10:09.985116 21366 tablet_bootstrap.cc:492] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:09.986591 21364 tablet_bootstrap.cc:654] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.990458 21366 tablet_bootstrap.cc:654] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:09.992336 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f91268c8384e79a83979ffd1c00d99" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:09.993129 21248 raft_consensus.cc:2463] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:09.997800 21364 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:09.998272 21364 ts_tablet_manager.cc:1397] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.006s
I20250109 21:10:10.000699 21364 raft_consensus.cc:357] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.001050 21366 tablet_bootstrap.cc:492] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.001513 21364 raft_consensus.cc:383] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.001716 21366 ts_tablet_manager.cc:1397] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.004s
I20250109 21:10:10.003510 21365 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:10.004980 21366 raft_consensus.cc:357] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.005638 21366 raft_consensus.cc:383] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.005558 21454 raft_consensus.cc:513] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.006027 21366 raft_consensus.cc:738] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.006752 21365 ts_tablet_manager.cc:1397] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.176s user 0.012s sys 0.006s
I20250109 21:10:10.001850 21364 raft_consensus.cc:738] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.009414 21364 consensus_queue.cc:260] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.011504 21364 ts_tablet_manager.cc:1428] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.013s user 0.002s sys 0.003s
I20250109 21:10:10.008148 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f91268c8384e79a83979ffd1c00d99" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:10.012284 21248 raft_consensus.cc:3054] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.016557 21365 raft_consensus.cc:357] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.016780 21473 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:10.017360 21365 raft_consensus.cc:383] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.017748 21365 raft_consensus.cc:738] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.018378 21364 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:10.018417 21365 consensus_queue.cc:260] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.020859 21365 ts_tablet_manager.cc:1428] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20250109 21:10:10.017745 21248 raft_consensus.cc:2463] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:10.022908 21136 leader_election.cc:304] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:10.023777 21372 raft_consensus.cc:2798] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:10.024240 21372 raft_consensus.cc:695] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:10.024560 21364 tablet_bootstrap.cc:654] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.024907 21372 consensus_queue.cc:237] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.007349 21366 consensus_queue.cc:260] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.029103 21366 ts_tablet_manager.cc:1428] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.026s user 0.004s sys 0.000s
I20250109 21:10:10.029927 21366 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.032581 21365 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:10.036741 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "73f91268c8384e79a83979ffd1c00d99" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:10.037369 21319 raft_consensus.cc:3054] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.039867 21365 tablet_bootstrap.cc:654] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.042519 21366 tablet_bootstrap.cc:654] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.009135 21454 leader_election.cc:290] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.055769 21366 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.056243 21366 ts_tablet_manager.cc:1397] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.026s user 0.010s sys 0.000s
I20250109 21:10:10.062242 21366 raft_consensus.cc:357] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.062983 21366 raft_consensus.cc:383] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.063254 21366 raft_consensus.cc:738] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.063905 21366 consensus_queue.cc:260] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.068408 21366 ts_tablet_manager.cc:1428] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20250109 21:10:10.069239 21366 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.072813 21319 raft_consensus.cc:2463] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:10.074759 21365 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:10.077692 21365 ts_tablet_manager.cc:1397] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.045s user 0.009s sys 0.009s
I20250109 21:10:10.079309 21364 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:10.079968 21364 ts_tablet_manager.cc:1397] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.062s user 0.015s sys 0.021s
I20250109 21:10:10.079296 21069 catalog_manager.cc:5526] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:10.082178 21416 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:10.076861 21366 tablet_bootstrap.cc:654] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.082314 21364 raft_consensus.cc:357] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.084079 21365 raft_consensus.cc:357] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.090492 21365 raft_consensus.cc:383] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.091194 21365 raft_consensus.cc:738] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.089187 21364 raft_consensus.cc:383] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.103080 21364 raft_consensus.cc:738] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.103814 21364 consensus_queue.cc:260] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.105796 21365 consensus_queue.cc:260] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.109975 21365 ts_tablet_manager.cc:1428] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.030s user 0.005s sys 0.000s
I20250109 21:10:10.112243 21365 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:10.106982 21364 ts_tablet_manager.cc:1428] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.027s user 0.007s sys 0.000s
I20250109 21:10:10.119607 21365 tablet_bootstrap.cc:654] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.123757 21366 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.124437 21366 ts_tablet_manager.cc:1397] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.055s user 0.009s sys 0.005s
I20250109 21:10:10.127672 21366 raft_consensus.cc:357] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.128187 21364 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:10.130323 21366 raft_consensus.cc:383] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.130669 21366 raft_consensus.cc:738] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.131280 21366 consensus_queue.cc:260] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:10.133728 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:10.136186 21366 ts_tablet_manager.cc:1428] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.011s user 0.004s sys 0.002s
I20250109 21:10:10.137022 21366 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.137876 21632 raft_consensus.cc:491] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.138307 21632 raft_consensus.cc:513] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.140170 21632 leader_election.cc:290] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.141963 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909c8965e81d4f84a75ef2fd61bcbe72" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.142474 21364 tablet_bootstrap.cc:654] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.142613 21248 raft_consensus.cc:2463] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:10.144387 21288 leader_election.cc:304] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:10.145351 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909c8965e81d4f84a75ef2fd61bcbe72" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.145967 21167 raft_consensus.cc:2463] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:10.147523 21632 raft_consensus.cc:2798] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:10.147931 21632 raft_consensus.cc:491] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:10.148334 21632 raft_consensus.cc:3054] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.150898 21622 consensus_queue.cc:1035] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:10.155632 21622 raft_consensus.cc:491] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.156039 21622 raft_consensus.cc:513] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.156946 21365 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:10.157485 21365 ts_tablet_manager.cc:1397] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.045s user 0.008s sys 0.002s
I20250109 21:10:10.159073 21366 tablet_bootstrap.cc:654] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.156430 21632 raft_consensus.cc:513] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.158818 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
W20250109 21:10:10.160445 21213 leader_election.cc:343] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.161418 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:10.162926 21214 leader_election.cc:343] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.163487 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909c8965e81d4f84a75ef2fd61bcbe72" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:10.163731 21622 leader_election.cc:290] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.164275 21165 raft_consensus.cc:3054] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.163494 21214 leader_election.cc:304] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:10.169341 21416 raft_consensus.cc:2743] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:10.173740 21319 raft_consensus.cc:3054] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.178548 21323 raft_consensus.cc:3054] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.187395 21416 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:10.191987 21611 raft_consensus.cc:491] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.192451 21611 raft_consensus.cc:513] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.194305 21611 leader_election.cc:290] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.195622 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.198166 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.200474 21365 raft_consensus.cc:357] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.201030 21288 leader_election.cc:304] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:10.201823 21632 leader_election.cc:290] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.205492 21632 raft_consensus.cc:2743] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:10.186450 21165 raft_consensus.cc:2463] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:10.206339 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909c8965e81d4f84a75ef2fd61bcbe72" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:10.206966 21365 raft_consensus.cc:383] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.207595 21365 raft_consensus.cc:738] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.208009 21288 leader_election.cc:304] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:10.207127 21244 raft_consensus.cc:3054] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.208410 21365 consensus_queue.cc:260] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.211270 21622 raft_consensus.cc:491] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.211853 21622 raft_consensus.cc:513] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.213420 21511 raft_consensus.cc:2798] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:10.213878 21511 raft_consensus.cc:695] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:10.214612 21511 consensus_queue.cc:237] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.215313 21622 leader_election.cc:290] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.217005 21416 raft_consensus.cc:491] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.223577 21416 raft_consensus.cc:513] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.225948 21416 leader_election.cc:290] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.227811 21454 raft_consensus.cc:491] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.228384 21454 raft_consensus.cc:513] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.232271 21244 raft_consensus.cc:2463] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:10.232349 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.233106 21248 raft_consensus.cc:2463] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:10.234730 21136 leader_election.cc:304] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:10.236079 21619 raft_consensus.cc:2798] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:10.236557 21619 raft_consensus.cc:491] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:10.236958 21619 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.238803 21364 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:10.239285 21364 ts_tablet_manager.cc:1397] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.111s user 0.013s sys 0.006s
I20250109 21:10:10.218017 21621 consensus_queue.cc:1035] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:10.218638 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e719827258244d4c9a82be8775a044f5" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:10.240319 21321 raft_consensus.cc:2463] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:10.230633 21454 leader_election.cc:290] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.246304 21473 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:10.247041 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.248374 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e719827258244d4c9a82be8775a044f5" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.256006 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:10.257076 21069 catalog_manager.cc:5526] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
W20250109 21:10:10.260159 21137 leader_election.cc:343] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.260493 21364 raft_consensus.cc:357] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.261149 21364 raft_consensus.cc:383] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.261404 21364 raft_consensus.cc:738] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.249723 21619 raft_consensus.cc:513] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.252578 21214 leader_election.cc:304] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:10.261953 21365 ts_tablet_manager.cc:1428] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.104s user 0.007s sys 0.000s
I20250109 21:10:10.262814 21416 raft_consensus.cc:2798] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:10.263051 21365 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:10.263275 21416 raft_consensus.cc:491] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:10.263664 21416 raft_consensus.cc:3054] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.265378 21364 consensus_queue.cc:260] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.268088 21364 ts_tablet_manager.cc:1428] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.029s user 0.004s sys 0.001s
I20250109 21:10:10.269997 21365 tablet_bootstrap.cc:654] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.271893 21366 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.272325 21366 ts_tablet_manager.cc:1397] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.135s user 0.037s sys 0.069s
I20250109 21:10:10.274495 21366 raft_consensus.cc:357] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.279850 21366 raft_consensus.cc:383] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.280148 21366 raft_consensus.cc:738] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.280824 21366 consensus_queue.cc:260] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.281504 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:10.282068 21243 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.282960 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:10.283524 21321 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.287155 21619 leader_election.cc:290] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.288008 21243 raft_consensus.cc:2463] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:10.289040 21136 leader_election.cc:304] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:10.289841 21321 raft_consensus.cc:2463] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:10.290556 21619 raft_consensus.cc:2798] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:10.291178 21619 raft_consensus.cc:695] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:10.291888 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:10.253299 21213 leader_election.cc:343] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.293336 21364 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
W20250109 21:10:10.293824 21214 leader_election.cc:343] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.294245 21214 leader_election.cc:304] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:10.295271 21621 raft_consensus.cc:2743] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:10.295192 21416 raft_consensus.cc:513] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.297066 21416 leader_election.cc:290] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
W20250109 21:10:10.297784 21213 leader_election.cc:343] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.291918 21619 consensus_queue.cc:237] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.299629 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e719827258244d4c9a82be8775a044f5" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
W20250109 21:10:10.301637 21213 leader_election.cc:343] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.305308 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e719827258244d4c9a82be8775a044f5" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:10.305811 21323 raft_consensus.cc:3054] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.307180 21366 ts_tablet_manager.cc:1428] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
I20250109 21:10:10.312700 21364 tablet_bootstrap.cc:654] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.317373 21323 raft_consensus.cc:2463] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:10.318481 21214 leader_election.cc:304] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:10.319479 21622 raft_consensus.cc:2798] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:10.319911 21622 raft_consensus.cc:695] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:10.320652 21622 consensus_queue.cc:237] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.322418 21366 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.328846 21366 tablet_bootstrap.cc:654] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.335932 21365 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:10.336477 21365 ts_tablet_manager.cc:1397] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.074s user 0.014s sys 0.031s
I20250109 21:10:10.335817 21069 catalog_manager.cc:5526] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:10.337736 21611 raft_consensus.cc:491] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.338196 21611 raft_consensus.cc:513] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.340248 21611 leader_election.cc:290] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.347471 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a48f8e1e34fba9a5089b31d8966e7" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.349501 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a48f8e1e34fba9a5089b31d8966e7" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.350327 21243 raft_consensus.cc:2463] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:10.351686 21365 raft_consensus.cc:357] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.352592 21365 raft_consensus.cc:383] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.352895 21365 raft_consensus.cc:738] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.354295 21365 consensus_queue.cc:260] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.356341 21365 ts_tablet_manager.cc:1428] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.020s user 0.005s sys 0.002s
I20250109 21:10:10.357061 21365 tablet_bootstrap.cc:492] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
W20250109 21:10:10.357609 21288 leader_election.cc:343] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.358207 21288 leader_election.cc:304] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:10.360044 21511 raft_consensus.cc:2798] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:10.360394 21511 raft_consensus.cc:491] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:10.360707 21511 raft_consensus.cc:3054] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.360611 21454 raft_consensus.cc:491] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.361380 21454 raft_consensus.cc:513] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.362347 21365 tablet_bootstrap.cc:654] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.363283 21454 leader_election.cc:290] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
W20250109 21:10:10.364921 21137 consensus_peers.cc:487] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:10.367312 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:10.370442 21137 leader_election.cc:343] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.373167 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.373594 21364 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:10.374022 21364 ts_tablet_manager.cc:1397] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.081s user 0.017s sys 0.015s
W20250109 21:10:10.374361 21136 leader_election.cc:343] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.374787 21136 leader_election.cc:304] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:10.376142 21634 raft_consensus.cc:2743] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:10.376566 21364 raft_consensus.cc:357] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.377485 21364 raft_consensus.cc:383] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.377770 21364 raft_consensus.cc:738] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.378448 21364 consensus_queue.cc:260] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.383070 21364 ts_tablet_manager.cc:1428] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20250109 21:10:10.383920 21364 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:10.394275 21364 tablet_bootstrap.cc:654] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.394873 21634 consensus_queue.cc:1035] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:10.400365 21366 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.400808 21366 ts_tablet_manager.cc:1397] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.083s user 0.008s sys 0.021s
I20250109 21:10:10.403396 21323 raft_consensus.cc:3054] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.407677 21366 raft_consensus.cc:357] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.408447 21366 raft_consensus.cc:383] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.408706 21366 raft_consensus.cc:738] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.409377 21366 consensus_queue.cc:260] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.370325 21069 catalog_manager.cc:5526] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:10.411501 21366 ts_tablet_manager.cc:1428] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250109 21:10:10.412848 21366 tablet_bootstrap.cc:492] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.419369 21366 tablet_bootstrap.cc:654] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.431800 21366 tablet_bootstrap.cc:492] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.431869 21511 raft_consensus.cc:513] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.432476 21366 ts_tablet_manager.cc:1397] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.020s user 0.013s sys 0.003s
I20250109 21:10:10.433732 21511 leader_election.cc:290] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.436825 21366 raft_consensus.cc:357] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.437630 21366 raft_consensus.cc:383] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.437961 21366 raft_consensus.cc:738] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.438691 21366 consensus_queue.cc:260] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.441587 21366 ts_tablet_manager.cc:1428] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250109 21:10:10.442646 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a48f8e1e34fba9a5089b31d8966e7" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:10.442616 21366 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.444519 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a48f8e1e34fba9a5089b31d8966e7" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:10.445032 21248 raft_consensus.cc:3054] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.450613 21366 tablet_bootstrap.cc:654] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:10.453023 21288 leader_election.cc:343] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.474967 21366 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.475442 21366 ts_tablet_manager.cc:1397] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.033s user 0.014s sys 0.004s
I20250109 21:10:10.478806 21366 raft_consensus.cc:357] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.479487 21366 raft_consensus.cc:383] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.480629 21619 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:10.479761 21366 raft_consensus.cc:738] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.481770 21366 consensus_queue.cc:260] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.485478 21248 raft_consensus.cc:2463] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:10.489876 21366 ts_tablet_manager.cc:1428] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20250109 21:10:10.494953 21366 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.503098 21511 raft_consensus.cc:491] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.503672 21511 raft_consensus.cc:513] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.505446 21511 leader_election.cc:290] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.509716 21366 tablet_bootstrap.cc:654] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.511232 21167 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.511849 21167 raft_consensus.cc:2463] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:10.513552 21288 leader_election.cc:304] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:10.514240 21611 raft_consensus.cc:2798] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:10.514663 21611 raft_consensus.cc:695] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:10.515441 21611 consensus_queue.cc:237] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.523268 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.529011 21634 raft_consensus.cc:491] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.562220 21632 raft_consensus.cc:491] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:10.571805 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 45771.8us
I20250109 21:10:10.578378 21634 raft_consensus.cc:513] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.602192 21634 leader_election.cc:290] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.579274 21632 raft_consensus.cc:513] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.604426 21632 leader_election.cc:290] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.600026 21511 raft_consensus.cc:491] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.611330 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d059ec48cb46dfac04405794b984ee" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.612267 21244 raft_consensus.cc:2463] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:10.615474 21136 leader_election.cc:304] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:10.615697 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d059ec48cb46dfac04405794b984ee" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:10.616456 21634 raft_consensus.cc:2798] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:10.616940 21634 raft_consensus.cc:491] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:10.617337 21634 raft_consensus.cc:3054] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.617370 21372 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250109 21:10:10.619854 21137 leader_election.cc:343] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.611958 21511 raft_consensus.cc:513] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.628338 21511 leader_election.cc:290] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.636395 21288 leader_election.cc:304] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:10.641291 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfae02cdbdc49daa617467659ffaed6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.645884 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.648254 21634 raft_consensus.cc:513] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.651618 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d059ec48cb46dfac04405794b984ee" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:10.652158 21244 raft_consensus.cc:3054] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.653517 21632 raft_consensus.cc:2798] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:10.654018 21632 raft_consensus.cc:491] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:10.654382 21632 raft_consensus.cc:3054] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.658144 21244 raft_consensus.cc:2463] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:10.659327 21136 leader_election.cc:304] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:10.660125 21372 raft_consensus.cc:2798] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:10.660651 21372 raft_consensus.cc:695] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:10.661309 21372 consensus_queue.cc:237] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.672978 21634 leader_election.cc:290] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.690675 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8d059ec48cb46dfac04405794b984ee" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:10.693094 21372 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250109 21:10:10.709861 21137 leader_election.cc:343] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.683526 21066 catalog_manager.cc:5526] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:10.724792 21416 raft_consensus.cc:491] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.725440 21416 raft_consensus.cc:513] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.729002 21416 leader_election.cc:290] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:10.738327 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:10.741220 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.747793 21321 raft_consensus.cc:2463] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:10.748173 21364 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
W20250109 21:10:10.748296 21213 leader_election.cc:343] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.748832 21364 ts_tablet_manager.cc:1397] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.365s user 0.115s sys 0.151s
I20250109 21:10:10.749223 21214 leader_election.cc:304] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:10.750207 21622 raft_consensus.cc:2798] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:10.750650 21622 raft_consensus.cc:491] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:10.751065 21622 raft_consensus.cc:3054] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.753230 21364 raft_consensus.cc:357] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.753875 21364 raft_consensus.cc:383] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.754127 21364 raft_consensus.cc:738] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.754859 21366 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.754731 21364 consensus_queue.cc:260] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.755457 21366 ts_tablet_manager.cc:1397] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.265s user 0.053s sys 0.073s
I20250109 21:10:10.756634 21364 ts_tablet_manager.cc:1428] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:10:10.757251 21364 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:10.758487 21366 raft_consensus.cc:357] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.759305 21366 raft_consensus.cc:383] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.759626 21366 raft_consensus.cc:738] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.760360 21366 consensus_queue.cc:260] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.762120 21364 tablet_bootstrap.cc:654] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.765076 21366 ts_tablet_manager.cc:1428] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20250109 21:10:10.766008 21366 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.772289 21366 tablet_bootstrap.cc:654] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.770373 21622 raft_consensus.cc:513] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.775302 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:10.775668 21069 catalog_manager.cc:5526] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
W20250109 21:10:10.776510 21213 leader_election.cc:343] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.741238 21632 raft_consensus.cc:513] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.746593 21511 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250109 21:10:10.747398 21288 leader_election.cc:343] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:10.792414 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 45048.2us
I20250109 21:10:10.793025 21632 leader_election.cc:290] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.786973 21365 tablet_bootstrap.cc:492] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:10.794934 21622 leader_election.cc:290] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
W20250109 21:10:10.799399 21288 leader_election.cc:343] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.800984 21365 ts_tablet_manager.cc:1397] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.444s user 0.123s sys 0.179s
I20250109 21:10:10.808414 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:10.810034 21321 raft_consensus.cc:3054] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.815264 21454 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:10.825485 21364 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:10.825951 21364 ts_tablet_manager.cc:1397] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.069s user 0.023s sys 0.033s
I20250109 21:10:10.826496 21366 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:10.826974 21366 ts_tablet_manager.cc:1397] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.061s user 0.011s sys 0.001s
I20250109 21:10:10.840413 21366 raft_consensus.cc:357] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.840011 21364 raft_consensus.cc:357] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.843051 21364 raft_consensus.cc:383] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.843556 21364 raft_consensus.cc:738] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.842836 21366 raft_consensus.cc:383] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.844182 21366 raft_consensus.cc:738] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.844838 21366 consensus_queue.cc:260] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.845227 21364 consensus_queue.cc:260] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.851137 21364 ts_tablet_manager.cc:1428] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.025s user 0.007s sys 0.002s
I20250109 21:10:10.852279 21364 tablet_bootstrap.cc:492] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:10.827086 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:10.868842 21165 raft_consensus.cc:3054] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:10.855738 21366 ts_tablet_manager.cc:1428] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.028s user 0.004s sys 0.002s
I20250109 21:10:10.867358 21632 raft_consensus.cc:491] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:10.871666 21366 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:10.879722 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8bfae02cdbdc49daa617467659ffaed6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.885483 21365 raft_consensus.cc:357] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.885821 21245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:10.886229 21365 raft_consensus.cc:383] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.886557 21365 raft_consensus.cc:738] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.887060 21365 consensus_queue.cc:260] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.873529 21632 raft_consensus.cc:513] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.887475 21245 raft_consensus.cc:3054] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:10.897229 21213 consensus_peers.cc:487] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:10.898185 21690 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:10.899341 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.901261 21243 raft_consensus.cc:2388] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0175ef2fbd0349568ba2bf83788476ea in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
I20250109 21:10:10.901386 21632 leader_election.cc:290] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:10.911675 21288 leader_election.cc:304] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:10.913499 21432 raft_consensus.cc:2743] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:10.915702 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:10.921092 21365 ts_tablet_manager.cc:1428] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.119s user 0.007s sys 0.000s
I20250109 21:10:10.922016 21365 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:10.928206 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:10.928550 21288 leader_election.cc:304] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
W20250109 21:10:10.936268 21288 leader_election.cc:343] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:10.936966 21288 consensus_peers.cc:487] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:10.937464 21288 leader_election.cc:343] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:10.937806 21288 leader_election.cc:304] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:10.938454 21432 raft_consensus.cc:2743] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:10.950544 21364 tablet_bootstrap.cc:654] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.950639 21245 raft_consensus.cc:2463] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:10.956331 21165 raft_consensus.cc:2463] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:10.959182 21365 tablet_bootstrap.cc:654] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.958391 21366 tablet_bootstrap.cc:654] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:10.949860 21321 raft_consensus.cc:2463] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:10.960211 21632 raft_consensus.cc:2743] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:10.960758 21288 leader_election.cc:304] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:10.961505 21432 raft_consensus.cc:2798] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:10.961951 21432 raft_consensus.cc:695] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:10.962726 21432 consensus_queue.cc:237] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.965787 21214 leader_election.cc:304] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:10.966892 21622 raft_consensus.cc:2798] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:10.967485 21622 raft_consensus.cc:695] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:10.968266 21622 consensus_queue.cc:237] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.973682 21364 tablet_bootstrap.cc:492] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:10.974170 21364 ts_tablet_manager.cc:1397] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.122s user 0.008s sys 0.003s
I20250109 21:10:10.982241 21364 raft_consensus.cc:357] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.993996 21364 raft_consensus.cc:383] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:10.994336 21364 raft_consensus.cc:738] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:10.995047 21364 consensus_queue.cc:260] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:10.995306 21698 consensus_queue.cc:1035] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:11.000151 21364 ts_tablet_manager.cc:1428] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.026s user 0.008s sys 0.000s
I20250109 21:10:11.001353 21364 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:11.025215 21321 raft_consensus.cc:3054] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:11.024531 21069 catalog_manager.cc:5526] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:11.049191 21366 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:11.049656 21366 ts_tablet_manager.cc:1397] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.178s user 0.011s sys 0.024s
I20250109 21:10:11.054543 21366 raft_consensus.cc:357] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.055526 21366 raft_consensus.cc:383] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.055779 21366 raft_consensus.cc:738] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.056450 21366 consensus_queue.cc:260] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.057884 21365 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:11.059367 21365 ts_tablet_manager.cc:1397] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.138s user 0.010s sys 0.009s
I20250109 21:10:11.058925 21366 ts_tablet_manager.cc:1428] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250109 21:10:11.052577 21066 catalog_manager.cc:5526] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:11.068857 21366 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:11.059983 21364 tablet_bootstrap.cc:654] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.063727 21323 raft_consensus.cc:3054] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:11.071938 21365 raft_consensus.cc:357] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.072597 21365 raft_consensus.cc:383] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.072777 21365 raft_consensus.cc:738] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.062459 21621 raft_consensus.cc:491] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.075589 21621 raft_consensus.cc:513] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.077508 21621 leader_election.cc:290] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.079049 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:11.080430 21214 leader_election.cc:343] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.081598 21365 consensus_queue.cc:260] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.085647 21372 raft_consensus.cc:491] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.086035 21372 raft_consensus.cc:513] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.063185 21634 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.027s
I20250109 21:10:11.092564 21372 leader_election.cc:290] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.096990 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a48f8e1e34fba9a5089b31d8966e7" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:11.098790 21365 ts_tablet_manager.cc:1428] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.031s user 0.005s sys 0.001s
I20250109 21:10:11.099442 21365 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:11.101666 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b45a48f8e1e34fba9a5089b31d8966e7" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:11.092571 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:11.102392 21248 raft_consensus.cc:2388] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:11.103363 21702 consensus_queue.cc:1035] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:11.103880 21634 raft_consensus.cc:491] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:11.104017 21213 leader_election.cc:343] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.104467 21213 leader_election.cc:304] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:11.104358 21634 raft_consensus.cc:513] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.105624 21137 leader_election.cc:304] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:11.106595 21619 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:11.107074 21454 raft_consensus.cc:3054] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:11.109709 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f76b5c3db5e4c1885ce16d810372999" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:11.114573 21136 leader_election.cc:343] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.107362 21634 leader_election.cc:290] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.123504 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f76b5c3db5e4c1885ce16d810372999" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:11.110718 21622 raft_consensus.cc:2743] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:11.136513 21702 raft_consensus.cc:491] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:11.150138 21137 leader_election.cc:343] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.150560 21137 leader_election.cc:304] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:11.151407 21372 raft_consensus.cc:2743] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:11.150202 21702 raft_consensus.cc:513] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.153302 21366 tablet_bootstrap.cc:654] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.153620 21702 leader_election.cc:290] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:11.157241 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963062e448e46b3b27c83dd6c77b956" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:11.157991 21454 raft_consensus.cc:2743] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:11.170786 21365 tablet_bootstrap.cc:654] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.173393 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2963062e448e46b3b27c83dd6c77b956" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:11.184304 21364 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:11.184809 21364 ts_tablet_manager.cc:1397] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.184s user 0.018s sys 0.005s
I20250109 21:10:11.191897 21364 raft_consensus.cc:357] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.192622 21364 raft_consensus.cc:383] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.192888 21364 raft_consensus.cc:738] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.193496 21364 consensus_queue.cc:260] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.196117 21364 ts_tablet_manager.cc:1428] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:10:11.196982 21364 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:11.202538 21364 tablet_bootstrap.cc:654] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.208684 21288 leader_election.cc:304] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:11.222050 21702 raft_consensus.cc:2743] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:11.247933 21366 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:11.248473 21366 ts_tablet_manager.cc:1397] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.180s user 0.024s sys 0.035s
I20250109 21:10:11.251217 21366 raft_consensus.cc:357] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.252063 21366 raft_consensus.cc:383] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.252377 21366 raft_consensus.cc:738] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.253230 21366 consensus_queue.cc:260] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.255694 21366 ts_tablet_manager.cc:1428] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:10:11.257941 21366 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:11.264580 21366 tablet_bootstrap.cc:654] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.273996 21365 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:11.274418 21365 ts_tablet_manager.cc:1397] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.175s user 0.029s sys 0.030s
I20250109 21:10:11.274158 21364 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:11.276106 21364 ts_tablet_manager.cc:1397] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.079s user 0.005s sys 0.005s
I20250109 21:10:11.281265 21364 raft_consensus.cc:357] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.282006 21364 raft_consensus.cc:383] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.282292 21364 raft_consensus.cc:738] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.282893 21364 consensus_queue.cc:260] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.285017 21364 ts_tablet_manager.cc:1428] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20250109 21:10:11.286180 21365 raft_consensus.cc:357] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.286979 21365 raft_consensus.cc:383] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.287065 21364 tablet_bootstrap.cc:492] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:11.287281 21365 raft_consensus.cc:738] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.288123 21365 consensus_queue.cc:260] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.294880 21364 tablet_bootstrap.cc:654] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.297302 21365 ts_tablet_manager.cc:1428] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20250109 21:10:11.298161 21365 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:11.305167 21366 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:11.305680 21366 ts_tablet_manager.cc:1397] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.048s user 0.014s sys 0.003s
I20250109 21:10:11.307761 21365 tablet_bootstrap.cc:654] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.317874 21366 raft_consensus.cc:357] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.319540 21366 raft_consensus.cc:383] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.318442 21621 raft_consensus.cc:491] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.320345 21621 raft_consensus.cc:513] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.319866 21366 raft_consensus.cc:738] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.321813 21366 consensus_queue.cc:260] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.324168 21366 ts_tablet_manager.cc:1428] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250109 21:10:11.322237 21621 leader_election.cc:290] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.325100 21366 tablet_bootstrap.cc:492] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:11.325812 21690 raft_consensus.cc:491] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:11.339519 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:11.330063 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a96090bb1b54bf1b35f150050e71ee7" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:11.340736 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a96090bb1b54bf1b35f150050e71ee7" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:11.341418 21213 leader_election.cc:343] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.329165 21690 raft_consensus.cc:513] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:11.342739 21214 leader_election.cc:343] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.343338 21214 leader_election.cc:304] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:11.344381 21690 leader_election.cc:290] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:11.345379 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:11.345739 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:11.346367 21248 raft_consensus.cc:2463] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:11.347615 21288 leader_election.cc:304] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:11.348634 21690 raft_consensus.cc:2798] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:11.348987 21690 raft_consensus.cc:491] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:11.349490 21690 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:11.350320 21698 raft_consensus.cc:2743] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:11.351153 21288 leader_election.cc:343] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.363480 21366 tablet_bootstrap.cc:654] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.372211 21365 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:11.372774 21365 ts_tablet_manager.cc:1397] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.075s user 0.036s sys 0.022s
I20250109 21:10:11.372224 21366 tablet_bootstrap.cc:492] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:11.375401 21366 ts_tablet_manager.cc:1397] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.050s user 0.011s sys 0.005s
I20250109 21:10:11.375349 21365 raft_consensus.cc:357] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.376344 21365 raft_consensus.cc:383] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.376677 21365 raft_consensus.cc:738] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.377439 21365 consensus_queue.cc:260] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.378759 21690 raft_consensus.cc:513] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.379905 21365 ts_tablet_manager.cc:1428] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250109 21:10:11.380620 21690 leader_election.cc:290] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:11.381108 21365 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:11.381965 21366 raft_consensus.cc:357] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.386370 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:11.387729 21365 tablet_bootstrap.cc:654] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.388267 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:11.388821 21248 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:11.382709 21366 raft_consensus.cc:383] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.391081 21366 raft_consensus.cc:738] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.391933 21366 consensus_queue.cc:260] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.395121 21366 ts_tablet_manager.cc:1428] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.019s user 0.008s sys 0.000s
I20250109 21:10:11.398136 21366 tablet_bootstrap.cc:492] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:11.405993 21366 tablet_bootstrap.cc:654] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.406139 21621 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250109 21:10:11.411309 21288 leader_election.cc:343] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.418828 21364 tablet_bootstrap.cc:492] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:11.419489 21364 ts_tablet_manager.cc:1397] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.133s user 0.012s sys 0.019s
I20250109 21:10:11.423241 21248 raft_consensus.cc:2463] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:11.424938 21288 leader_election.cc:304] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:11.426282 21702 raft_consensus.cc:2798] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:11.427657 21702 raft_consensus.cc:695] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:11.429698 21702 consensus_queue.cc:237] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.431566 21611 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:11.442131 21165 raft_consensus.cc:3054] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:11.441346 21364 raft_consensus.cc:357] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.444185 21432 raft_consensus.cc:491] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.444722 21432 raft_consensus.cc:513] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.444000 21364 raft_consensus.cc:383] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.447527 21364 raft_consensus.cc:738] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.447616 21432 leader_election.cc:290] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:11.448675 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:11.451216 21245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:11.451674 21288 leader_election.cc:343] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.452083 21245 raft_consensus.cc:2463] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:11.453034 21634 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.453459 21365 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:11.453969 21365 ts_tablet_manager.cc:1397] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.073s user 0.018s sys 0.024s
I20250109 21:10:11.453478 21634 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.450636 21364 consensus_queue.cc:260] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.454882 21288 leader_election.cc:304] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:11.457635 21634 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.457799 21364 ts_tablet_manager.cc:1428] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20250109 21:10:11.458652 21364 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:11.458693 21432 raft_consensus.cc:2798] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:11.460698 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:11.462244 21245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:11.463234 21365 raft_consensus.cc:357] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.467284 21365 raft_consensus.cc:383] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.465127 21323 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:11.464948 21432 raft_consensus.cc:491] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:11.472357 21245 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:11.472764 21372 raft_consensus.cc:491] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.473177 21372 raft_consensus.cc:513] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.474884 21372 leader_election.cc:290] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.475747 21432 raft_consensus.cc:3054] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:11.468128 21365 raft_consensus.cc:738] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.469614 21137 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:11.480568 21372 raft_consensus.cc:2798] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:10:11.480964 21372 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:11.481349 21372 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:11.476486 21621 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20250109 21:10:11.484052 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:11.480237 21365 consensus_queue.cc:260] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.499540 21372 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.501231 21372 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.505174 21245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:11.511351 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:11.512126 21323 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:11.512238 21365 ts_tablet_manager.cc:1428] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.058s user 0.008s sys 0.001s
I20250109 21:10:11.513306 21245 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:11.513861 21245 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:11.515439 21136 leader_election.cc:304] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:11.537029 21365 tablet_bootstrap.cc:492] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:11.507229 21702 raft_consensus.cc:491] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:11.576166 21136 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:44109, user_credentials={real_user=slave}} blocked reactor thread for 60804us
I20250109 21:10:11.577364 21366 tablet_bootstrap.cc:492] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:11.578019 21366 ts_tablet_manager.cc:1397] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.181s user 0.009s sys 0.022s
I20250109 21:10:11.580788 21372 raft_consensus.cc:491] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.581527 21372 raft_consensus.cc:513] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.562994 21621 raft_consensus.cc:491] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.592758 21372 leader_election.cc:290] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.594789 21372 raft_consensus.cc:491] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.595989 21372 raft_consensus.cc:513] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.607973 21323 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 2.
I20250109 21:10:11.617466 21372 leader_election.cc:290] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.578351 21702 raft_consensus.cc:513] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.624854 21365 tablet_bootstrap.cc:654] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:11.624655 21137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 105040us
I20250109 21:10:11.638734 21137 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:11.596881 21621 raft_consensus.cc:513] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.640125 21372 raft_consensus.cc:2798] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:11.647747 21372 raft_consensus.cc:695] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:11.648725 21372 consensus_queue.cc:237] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.652073 21068 catalog_manager.cc:5526] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:11.660740 21622 raft_consensus.cc:491] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.661404 21622 raft_consensus.cc:513] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.663929 21622 leader_election.cc:290] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:11.694535 21702 leader_election.cc:290] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:11.700439 21432 raft_consensus.cc:513] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.702900 21622 raft_consensus.cc:491] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:11.703397 21622 raft_consensus.cc:513] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.705554 21621 leader_election.cc:290] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
W20250109 21:10:11.720213 21729 log.cc:926] Time spent T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53: Append to log took a long time: real 0.164s user 0.001s sys 0.000s
W20250109 21:10:11.719347 21725 log.cc:926] Time spent T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: Append to log took a long time: real 0.145s user 0.001s sys 0.000s
W20250109 21:10:11.729382 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 96944.6us
I20250109 21:10:11.802070 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:11.802824 21248 raft_consensus.cc:2463] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
W20250109 21:10:11.809593 21136 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:44109, user_credentials={real_user=slave}} blocked reactor thread for 152386us
I20250109 21:10:11.828426 21317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:11.829456 21317 raft_consensus.cc:2463] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:11.866997 21366 raft_consensus.cc:357] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.871968 21366 raft_consensus.cc:383] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:11.872411 21366 raft_consensus.cc:738] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:11.844769 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e719827258244d4c9a82be8775a044f5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:11.879282 21366 consensus_queue.cc:260] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:11.887533 21364 tablet_bootstrap.cc:654] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:11.887965 21167 raft_consensus.cc:3054] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:11.888375 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:11.885617 21317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f76b5c3db5e4c1885ce16d810372999" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:11.951231 21366 ts_tablet_manager.cc:1428] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.373s user 0.016s sys 0.010s
I20250109 21:10:11.904403 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:11.955894 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f76b5c3db5e4c1885ce16d810372999" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:11.951402 21317 raft_consensus.cc:2463] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:11.982759 21321 raft_consensus.cc:2388] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:11.984054 21323 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e719827258244d4c9a82be8775a044f5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:11.985236 21165 raft_consensus.cc:2463] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:11.987073 21244 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897320ddfb174b3c9c5751844ec65430" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:11.969839 21454 raft_consensus.cc:2743] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:11.988986 21432 leader_election.cc:290] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:11.963519 21622 leader_election.cc:290] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
W20250109 21:10:11.996347 21288 leader_election.cc:343] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:11.957582 21214 leader_election.cc:304] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
W20250109 21:10:12.029173 21245 consensus_meta.cc:287] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53: Time spent flushing consensus metadata: real 0.515s user 0.017s sys 0.004s
I20250109 21:10:12.029565 21245 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 2.
W20250109 21:10:12.032397 21213 leader_election.cc:343] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.033766 21213 leader_election.cc:304] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:12.034693 21749 raft_consensus.cc:2798] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:12.035156 21749 raft_consensus.cc:491] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:12.035140 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:12.035760 21749 raft_consensus.cc:3054] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.035883 21242 raft_consensus.cc:3054] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.046046 21169 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf52261cbf144de9a86b9f32c5ed7f0" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:12.066499 21611 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:12.042585 21622 raft_consensus.cc:2798] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:12.068218 21622 raft_consensus.cc:491] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:12.068583 21622 raft_consensus.cc:3054] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:12.064139 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 106668us
W20250109 21:10:12.073947 21136 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:44109, user_credentials={real_user=slave}} blocked reactor thread for 207058us
I20250109 21:10:12.079170 21136 leader_election.cc:304] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:12.082479 21136 leader_election.cc:304] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
W20250109 21:10:12.081691 21213 leader_election.cc:343] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.087144 21365 tablet_bootstrap.cc:492] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:12.087604 21365 ts_tablet_manager.cc:1397] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.551s user 0.014s sys 0.033s
I20250109 21:10:12.094133 21366 tablet_bootstrap.cc:492] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:12.081698 21754 raft_consensus.cc:2798] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:12.105039 21365 raft_consensus.cc:357] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.106293 21365 raft_consensus.cc:383] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.106577 21365 raft_consensus.cc:738] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.107105 21365 consensus_queue.cc:260] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.106371 21754 raft_consensus.cc:491] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:12.111261 21754 raft_consensus.cc:3054] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.116173 21365 ts_tablet_manager.cc:1428] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20250109 21:10:12.117023 21365 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:12.104822 21319 raft_consensus.cc:3054] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.129402 21317 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf52261cbf144de9a86b9f32c5ed7f0" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:12.142284 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897320ddfb174b3c9c5751844ec65430" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:12.157444 21242 raft_consensus.cc:2463] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:12.140709 21622 raft_consensus.cc:513] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.160667 21749 raft_consensus.cc:513] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.160681 21364 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:12.168030 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
W20250109 21:10:12.169445 21214 leader_election.cc:343] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:12.141865 21213 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 55536.2us
I20250109 21:10:12.191066 21364 ts_tablet_manager.cc:1397] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.733s user 0.020s sys 0.036s
I20250109 21:10:12.191706 21288 leader_election.cc:304] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:12.166563 21754 raft_consensus.cc:513] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.210551 21754 leader_election.cc:290] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.211201 21749 leader_election.cc:290] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.195494 21214 leader_election.cc:304] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
W20250109 21:10:12.213650 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 44242.8us
I20250109 21:10:12.214725 21760 raft_consensus.cc:2743] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:12.216254 21288 leader_election.cc:343] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.216780 21288 leader_election.cc:304] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:12.195300 21690 raft_consensus.cc:2798] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:12.276824 21364 raft_consensus.cc:357] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.277585 21364 raft_consensus.cc:383] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.277920 21364 raft_consensus.cc:738] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.279524 21364 consensus_queue.cc:260] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.248721 21755 raft_consensus.cc:2743] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:12.282182 21737 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20250109 21:10:12.286162 21248 raft_consensus.cc:1270] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250109 21:10:12.286187 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:12.287571 21316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f76b5c3db5e4c1885ce16d810372999" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:12.288131 21316 raft_consensus.cc:3054] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.280777 21164 raft_consensus.cc:2388] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 0175ef2fbd0349568ba2bf83788476ea in current term 1: Already voted for candidate 1774487f18694af1a5340fc8486cff53 in this term.
I20250109 21:10:12.290274 21622 leader_election.cc:290] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.290345 21247 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:12.290943 21364 ts_tablet_manager.cc:1428] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.098s user 0.010s sys 0.019s
I20250109 21:10:12.291190 21247 raft_consensus.cc:2388] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:12.291800 21365 tablet_bootstrap.cc:654] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.291810 21364 tablet_bootstrap.cc:492] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:12.279867 21690 raft_consensus.cc:695] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:12.296612 21690 consensus_queue.cc:237] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.310731 21366 tablet_bootstrap.cc:654] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.319747 21372 consensus_queue.cc:1035] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:12.327541 21137 leader_election.cc:304] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:12.328485 21372 raft_consensus.cc:2743] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:12.332636 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:12.338851 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
W20250109 21:10:12.340987 21288 consensus_peers.cc:487] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:12.333235 21321 raft_consensus.cc:3054] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.333436 21745 raft_consensus.cc:2743] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:12.371932 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:12.375125 21365 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:12.375756 21365 ts_tablet_manager.cc:1397] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.259s user 0.017s sys 0.016s
W20250109 21:10:12.369640 21213 leader_election.cc:343] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.385994 21365 raft_consensus.cc:357] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.386613 21365 raft_consensus.cc:383] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.386966 21365 raft_consensus.cc:738] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.387701 21365 consensus_queue.cc:260] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:12.387022 21761 log.cc:926] Time spent T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45: Append to log took a long time: real 0.051s user 0.001s sys 0.000s
I20250109 21:10:12.383683 21320 raft_consensus.cc:1270] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250109 21:10:12.385357 21316 raft_consensus.cc:2463] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:12.429896 21754 raft_consensus.cc:491] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:12.434458 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2f76b5c3db5e4c1885ce16d810372999" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:12.435081 21166 raft_consensus.cc:3054] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.441920 21214 leader_election.cc:304] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:12.442705 21760 raft_consensus.cc:2798] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:12.443225 21760 raft_consensus.cc:695] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:12.443967 21760 consensus_queue.cc:237] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.447559 21166 raft_consensus.cc:2463] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:12.450698 21366 tablet_bootstrap.cc:492] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:12.451185 21366 ts_tablet_manager.cc:1397] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.357s user 0.010s sys 0.024s
I20250109 21:10:12.457083 21364 tablet_bootstrap.cc:654] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.461398 21634 consensus_queue.cc:1035] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:12.430559 21754 raft_consensus.cc:513] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.463763 21365 ts_tablet_manager.cc:1428] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.088s user 0.017s sys 0.026s
I20250109 21:10:12.464308 21754 leader_election.cc:290] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.464660 21365 tablet_bootstrap.cc:492] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:12.457404 21321 raft_consensus.cc:2463] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:12.475667 21366 raft_consensus.cc:357] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.476648 21366 raft_consensus.cc:383] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.477001 21366 raft_consensus.cc:738] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.479149 21366 consensus_queue.cc:260] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.483192 21316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:12.483891 21316 raft_consensus.cc:2463] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:12.498111 21137 leader_election.cc:304] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:12.500077 21736 raft_consensus.cc:2798] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:12.500437 21736 raft_consensus.cc:491] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:12.500751 21736 raft_consensus.cc:3054] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.503206 21366 ts_tablet_manager.cc:1428] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.052s user 0.008s sys 0.000s
I20250109 21:10:12.504041 21366 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:12.513116 21736 raft_consensus.cc:513] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.514631 21736 leader_election.cc:290] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.516005 21241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:12.516669 21241 raft_consensus.cc:2463] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:12.517477 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:12.517911 21320 raft_consensus.cc:3054] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.523317 21364 tablet_bootstrap.cc:492] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:12.523664 21364 ts_tablet_manager.cc:1397] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.232s user 0.013s sys 0.023s
I20250109 21:10:12.506680 21214 leader_election.cc:304] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:12.531813 21749 raft_consensus.cc:2798] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:12.535791 21749 raft_consensus.cc:695] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
W20250109 21:10:12.532498 21773 log.cc:926] Time spent T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53: Append to log took a long time: real 0.073s user 0.000s sys 0.000s
I20250109 21:10:12.539733 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:12.540287 21248 raft_consensus.cc:3054] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.541554 21749 consensus_queue.cc:237] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.548636 21365 tablet_bootstrap.cc:654] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.553661 21248 raft_consensus.cc:2463] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:12.561828 21136 leader_election.cc:304] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:12.558550 21320 raft_consensus.cc:2463] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:12.562772 21754 raft_consensus.cc:2798] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:12.564499 21754 raft_consensus.cc:695] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:12.565272 21754 consensus_queue.cc:237] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.568539 21745 raft_consensus.cc:491] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:12.569012 21745 raft_consensus.cc:513] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.570813 21745 leader_election.cc:290] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.573348 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a96090bb1b54bf1b35f150050e71ee7" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:12.574568 21364 raft_consensus.cc:357] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.575299 21364 raft_consensus.cc:383] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.575567 21364 raft_consensus.cc:738] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.576154 21364 consensus_queue.cc:260] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.577852 21069 catalog_manager.cc:5526] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 2, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:12.579524 21366 tablet_bootstrap.cc:654] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.587283 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a96090bb1b54bf1b35f150050e71ee7" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:12.587896 21248 raft_consensus.cc:2463] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:12.588685 21136 leader_election.cc:304] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:12.589414 21736 raft_consensus.cc:2798] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:12.589749 21736 raft_consensus.cc:491] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:12.590080 21736 raft_consensus.cc:3054] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.596386 21736 raft_consensus.cc:513] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.598830 21241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a96090bb1b54bf1b35f150050e71ee7" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:12.599568 21241 raft_consensus.cc:3054] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.606184 21241 raft_consensus.cc:2463] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
W20250109 21:10:12.606716 21137 leader_election.cc:343] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.607066 21136 leader_election.cc:304] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:12.607787 21745 raft_consensus.cc:2798] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:12.608268 21745 raft_consensus.cc:695] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:12.609143 21745 consensus_queue.cc:237] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.613842 21736 leader_election.cc:290] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.615859 21364 ts_tablet_manager.cc:1428] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.092s user 0.005s sys 0.001s
I20250109 21:10:12.616833 21364 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:12.618772 21760 raft_consensus.cc:491] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:12.623332 21621 raft_consensus.cc:491] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:12.623551 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a96090bb1b54bf1b35f150050e71ee7" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:12.623811 21621 raft_consensus.cc:513] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.628934 21621 leader_election.cc:290] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.619271 21760 raft_consensus.cc:513] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:12.633095 21137 leader_election.cc:343] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.632048 21067 catalog_manager.cc:5526] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:12.634114 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897320ddfb174b3c9c5751844ec65430" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:12.634742 21319 raft_consensus.cc:2463] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:12.635362 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897320ddfb174b3c9c5751844ec65430" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:12.638590 21214 leader_election.cc:304] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:12.640605 21621 raft_consensus.cc:2798] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:12.640983 21621 raft_consensus.cc:491] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:12.641379 21621 raft_consensus.cc:3054] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.643101 21760 leader_election.cc:290] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.646977 21316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:12.649276 21214 leader_election.cc:343] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.649436 21365 tablet_bootstrap.cc:492] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:12.649927 21365 ts_tablet_manager.cc:1397] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.185s user 0.013s sys 0.000s
I20250109 21:10:12.650053 21366 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:12.650521 21366 ts_tablet_manager.cc:1397] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.147s user 0.028s sys 0.039s
W20250109 21:10:12.651268 21213 leader_election.cc:343] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.653354 21364 tablet_bootstrap.cc:654] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.653067 21366 raft_consensus.cc:357] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.654886 21366 raft_consensus.cc:383] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.655206 21366 raft_consensus.cc:738] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.655807 21366 consensus_queue.cc:260] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.656980 21068 catalog_manager.cc:5526] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:12.660209 21068 catalog_manager.cc:5526] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:12.661514 21365 raft_consensus.cc:357] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.661820 21621 raft_consensus.cc:513] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.662236 21365 raft_consensus.cc:383] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.662647 21365 raft_consensus.cc:738] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.663422 21365 consensus_queue.cc:260] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.659274 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:12.665735 21366 ts_tablet_manager.cc:1428] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.015s user 0.004s sys 0.004s
I20250109 21:10:12.666819 21366 tablet_bootstrap.cc:492] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:12.665177 21316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897320ddfb174b3c9c5751844ec65430" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:12.668251 21316 raft_consensus.cc:3054] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.668380 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "897320ddfb174b3c9c5751844ec65430" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:12.669334 21171 raft_consensus.cc:3054] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.673321 21365 ts_tablet_manager.cc:1428] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.023s user 0.006s sys 0.001s
I20250109 21:10:12.674170 21365 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
W20250109 21:10:12.676059 21213 leader_election.cc:343] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.676524 21213 leader_election.cc:304] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:12.678464 21760 raft_consensus.cc:2743] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:12.678932 21316 raft_consensus.cc:2463] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:12.679188 21171 raft_consensus.cc:2463] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:12.679947 21214 leader_election.cc:304] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:12.681284 21760 raft_consensus.cc:2798] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:12.665485 21621 leader_election.cc:290] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.681737 21760 raft_consensus.cc:695] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:12.682332 21366 tablet_bootstrap.cc:654] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.682595 21760 consensus_queue.cc:237] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.687718 21365 tablet_bootstrap.cc:654] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.694514 21069 catalog_manager.cc:5526] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:12.716624 21364 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:12.717067 21364 ts_tablet_manager.cc:1397] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.100s user 0.014s sys 0.005s
I20250109 21:10:12.717182 21366 tablet_bootstrap.cc:492] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:12.717612 21366 ts_tablet_manager.cc:1397] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.051s user 0.007s sys 0.011s
I20250109 21:10:12.709321 21069 catalog_manager.cc:5526] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:12.719839 21364 raft_consensus.cc:357] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.720485 21364 raft_consensus.cc:383] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.720734 21364 raft_consensus.cc:738] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.721338 21364 consensus_queue.cc:260] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.723724 21364 ts_tablet_manager.cc:1428] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20250109 21:10:12.724709 21364 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:12.731956 21366 raft_consensus.cc:357] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.732834 21366 raft_consensus.cc:383] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.733156 21366 raft_consensus.cc:738] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.730188 21364 tablet_bootstrap.cc:654] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.733949 21366 consensus_queue.cc:260] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.736188 21366 ts_tablet_manager.cc:1428] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20250109 21:10:12.740820 21366 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:12.741624 21365 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:12.745389 21365 ts_tablet_manager.cc:1397] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.071s user 0.012s sys 0.014s
I20250109 21:10:12.749802 21365 raft_consensus.cc:357] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.750516 21365 raft_consensus.cc:383] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.750789 21365 raft_consensus.cc:738] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.746384 21366 tablet_bootstrap.cc:654] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.755657 21365 consensus_queue.cc:260] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.763832 21366 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:12.764389 21366 ts_tablet_manager.cc:1397] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.024s user 0.006s sys 0.007s
I20250109 21:10:12.771709 21365 ts_tablet_manager.cc:1428] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20250109 21:10:12.766793 21366 raft_consensus.cc:357] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.773118 21366 raft_consensus.cc:383] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.773412 21366 raft_consensus.cc:738] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.772634 21365 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:12.775756 21066 catalog_manager.cc:5526] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:12.774096 21366 consensus_queue.cc:260] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.778998 21366 ts_tablet_manager.cc:1428] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.014s user 0.005s sys 0.002s
I20250109 21:10:12.779382 21730 raft_consensus.cc:491] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:12.779850 21730 raft_consensus.cc:513] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.781780 21730 leader_election.cc:290] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:12.783535 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf52261cbf144de9a86b9f32c5ed7f0" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:12.784145 21248 raft_consensus.cc:2463] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:12.785431 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf52261cbf144de9a86b9f32c5ed7f0" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:12.786134 21365 tablet_bootstrap.cc:654] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:12.789522 21288 leader_election.cc:343] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.790387 21288 leader_election.cc:304] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:12.794436 21730 raft_consensus.cc:2798] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:12.794934 21730 raft_consensus.cc:491] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:12.799543 21730 raft_consensus.cc:3054] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.809109 21611 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:12.818939 21366 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:12.828250 21366 tablet_bootstrap.cc:654] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.837141 21621 raft_consensus.cc:491] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:12.862957 21621 raft_consensus.cc:513] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.865469 21621 leader_election.cc:290] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.867834 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65dabcea5fff4017b727f2fcdee56246" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
W20250109 21:10:12.870738 21214 leader_election.cc:343] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.871212 21366 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:12.871685 21366 ts_tablet_manager.cc:1397] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.053s user 0.013s sys 0.000s
I20250109 21:10:12.874661 21366 raft_consensus.cc:357] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.875311 21366 raft_consensus.cc:383] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.822728 21730 raft_consensus.cc:513] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.875577 21366 raft_consensus.cc:738] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.878317 21366 consensus_queue.cc:260] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.880468 21366 ts_tablet_manager.cc:1428] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20250109 21:10:12.881176 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf52261cbf144de9a86b9f32c5ed7f0" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:12.881386 21366 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
W20250109 21:10:12.882364 21288 leader_election.cc:343] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.882005 21730 leader_election.cc:290] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:12.883755 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf52261cbf144de9a86b9f32c5ed7f0" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:12.884286 21248 raft_consensus.cc:3054] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.888978 21365 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:12.889417 21364 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:12.889475 21365 ts_tablet_manager.cc:1397] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.117s user 0.029s sys 0.031s
I20250109 21:10:12.889874 21364 ts_tablet_manager.cc:1397] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.165s user 0.045s sys 0.043s
I20250109 21:10:12.892096 21248 raft_consensus.cc:2463] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:12.891975 21365 raft_consensus.cc:357] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.892678 21365 raft_consensus.cc:383] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.892994 21365 raft_consensus.cc:738] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.893465 21366 tablet_bootstrap.cc:654] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.893893 21365 consensus_queue.cc:260] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.892997 21364 raft_consensus.cc:357] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.896534 21288 leader_election.cc:304] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:12.897344 21755 raft_consensus.cc:2798] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:12.896044 21364 raft_consensus.cc:383] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.897949 21364 raft_consensus.cc:738] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.898556 21364 consensus_queue.cc:260] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.899961 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65dabcea5fff4017b727f2fcdee56246" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:12.901005 21364 ts_tablet_manager.cc:1428] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.011s user 0.006s sys 0.002s
I20250109 21:10:12.901099 21755 raft_consensus.cc:695] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:12.901957 21755 consensus_queue.cc:237] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.903045 21728 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:12.903638 21690 raft_consensus.cc:491] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:12.904126 21690 raft_consensus.cc:513] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:12.905023 21213 leader_election.cc:343] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.905467 21213 leader_election.cc:304] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: f5d1eaae36f84176860e3799d49e4f53; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:12.905925 21690 leader_election.cc:290] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:12.906286 21621 raft_consensus.cc:2743] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:12.907716 21364 tablet_bootstrap.cc:492] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53: Bootstrap starting.
I20250109 21:10:12.908656 21365 ts_tablet_manager.cc:1428] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.019s user 0.006s sys 0.001s
I20250109 21:10:12.914058 21364 tablet_bootstrap.cc:654] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.918867 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:12.921496 21241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:12.924350 21365 tablet_bootstrap.cc:492] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:12.924574 21366 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:12.925021 21366 ts_tablet_manager.cc:1397] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.044s user 0.013s sys 0.006s
W20250109 21:10:12.929490 21288 leader_election.cc:343] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.929622 21366 raft_consensus.cc:357] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.930285 21366 raft_consensus.cc:383] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.930543 21366 raft_consensus.cc:738] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
W20250109 21:10:12.931059 21288 leader_election.cc:343] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:12.931466 21288 leader_election.cc:304] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:12.931244 21366 consensus_queue.cc:260] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.931638 21751 raft_consensus.cc:491] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:12.932309 21365 tablet_bootstrap.cc:654] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.932282 21751 raft_consensus.cc:513] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.935109 21755 raft_consensus.cc:2743] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:12.935285 21241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:12.937072 21366 ts_tablet_manager.cc:1428] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20250109 21:10:12.937897 21366 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: Bootstrap starting.
I20250109 21:10:12.938810 21365 tablet_bootstrap.cc:492] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:12.939210 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:12.940008 21319 raft_consensus.cc:2388] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
I20250109 21:10:12.941102 21137 leader_election.cc:304] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:12.939318 21365 ts_tablet_manager.cc:1397] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.000s
I20250109 21:10:12.942248 21745 raft_consensus.cc:3054] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.943253 21366 tablet_bootstrap.cc:654] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.944500 21365 raft_consensus.cc:357] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.945176 21365 raft_consensus.cc:383] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.945782 21365 raft_consensus.cc:738] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.946455 21365 consensus_queue.cc:260] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.948917 21365 ts_tablet_manager.cc:1428] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:12.950160 21365 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:12.952188 21751 leader_election.cc:290] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:12.953296 21745 raft_consensus.cc:2743] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:12.953576 21366 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: No bootstrap required, opened a new log
I20250109 21:10:12.954027 21366 ts_tablet_manager.cc:1397] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: Time spent bootstrapping tablet: real 0.016s user 0.008s sys 0.000s
I20250109 21:10:12.968462 21621 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:12.969503 21365 tablet_bootstrap.cc:654] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:12.977257 21364 tablet_bootstrap.cc:492] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53: No bootstrap required, opened a new log
I20250109 21:10:12.977828 21364 ts_tablet_manager.cc:1397] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53: Time spent bootstrapping tablet: real 0.070s user 0.016s sys 0.008s
I20250109 21:10:12.979492 21165 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:12.980245 21364 raft_consensus.cc:357] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.980912 21364 raft_consensus.cc:383] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.981179 21364 raft_consensus.cc:738] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.988612 21621 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:12.988696 21364 consensus_queue.cc:260] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.991153 21364 ts_tablet_manager.cc:1428] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20250109 21:10:12.991693 21366 raft_consensus.cc:357] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.992395 21366 raft_consensus.cc:383] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:12.992659 21366 raft_consensus.cc:738] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Initialized, Role: FOLLOWER
I20250109 21:10:12.993218 21366 consensus_queue.cc:260] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:12.995364 21366 ts_tablet_manager.cc:1428] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: Time spent starting tablet: real 0.041s user 0.007s sys 0.000s
I20250109 21:10:13.017043 21066 catalog_manager.cc:5526] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:13.028326 21365 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:13.028825 21365 ts_tablet_manager.cc:1397] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.079s user 0.011s sys 0.001s
I20250109 21:10:13.029884 21755 raft_consensus.cc:491] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:13.030371 21755 raft_consensus.cc:513] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.032313 21755 leader_election.cc:290] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:13.032935 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65dabcea5fff4017b727f2fcdee56246" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:13.033987 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65dabcea5fff4017b727f2fcdee56246" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:13.034171 21365 raft_consensus.cc:357] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
W20250109 21:10:13.034533 21288 leader_election.cc:343] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:13.034605 21242 raft_consensus.cc:2463] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:13.035091 21365 raft_consensus.cc:383] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:13.035387 21365 raft_consensus.cc:738] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:13.035778 21288 leader_election.cc:304] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:13.036077 21365 consensus_queue.cc:260] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.036707 21733 raft_consensus.cc:2798] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:13.037081 21733 raft_consensus.cc:491] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:13.037375 21733 raft_consensus.cc:3054] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.038466 21365 ts_tablet_manager.cc:1428] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.009s user 0.004s sys 0.003s
I20250109 21:10:13.039314 21365 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:13.045778 21365 tablet_bootstrap.cc:654] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:13.046095 21621 consensus_queue.cc:1035] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.053558 21733 raft_consensus.cc:513] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.056414 21699 consensus_queue.cc:1035] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.057438 21733 leader_election.cc:290] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:13.058642 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65dabcea5fff4017b727f2fcdee56246" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
W20250109 21:10:13.059903 21288 leader_election.cc:343] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:13.064234 21745 consensus_queue.cc:1035] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.062564 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65dabcea5fff4017b727f2fcdee56246" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:13.069073 21242 raft_consensus.cc:3054] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.086158 21690 raft_consensus.cc:491] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:13.086705 21690 raft_consensus.cc:513] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.090798 21241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a96090bb1b54bf1b35f150050e71ee7" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:13.091120 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4a96090bb1b54bf1b35f150050e71ee7" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
I20250109 21:10:13.091606 21241 raft_consensus.cc:2388] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 0175ef2fbd0349568ba2bf83788476ea in current term 1: Already voted for candidate 1774487f18694af1a5340fc8486cff53 in this term.
I20250109 21:10:13.092402 21736 consensus_queue.cc:1035] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.092423 21690 leader_election.cc:290] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:13.104609 21288 leader_election.cc:304] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:13.106602 21365 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:13.107079 21365 ts_tablet_manager.cc:1397] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.068s user 0.025s sys 0.025s
I20250109 21:10:13.107416 21690 raft_consensus.cc:3054] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.107442 21242 raft_consensus.cc:2463] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:13.109309 21288 leader_election.cc:304] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:13.110283 21733 raft_consensus.cc:2798] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:13.110996 21733 raft_consensus.cc:695] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:13.111799 21733 consensus_queue.cc:237] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.109829 21365 raft_consensus.cc:357] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.122026 21699 consensus_queue.cc:1035] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.128670 21365 raft_consensus.cc:383] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:13.130759 21690 raft_consensus.cc:2743] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:13.145936 21365 raft_consensus.cc:738] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:13.139940 21621 consensus_queue.cc:1035] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.146667 21365 consensus_queue.cc:260] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.151434 21736 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.169103 21066 catalog_manager.cc:5526] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:13.185765 21365 ts_tablet_manager.cc:1428] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.078s user 0.006s sys 0.000s
I20250109 21:10:13.186638 21365 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:13.188860 21621 raft_consensus.cc:491] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:13.189534 21621 raft_consensus.cc:513] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.194469 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33a9dea3cbbb40abbdf4eb26e597f857" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
W20250109 21:10:13.196300 21213 leader_election.cc:343] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:13.198536 21754 raft_consensus.cc:491] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:13.199331 21365 tablet_bootstrap.cc:654] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:13.199214 21754 raft_consensus.cc:513] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.203284 21754 leader_election.cc:290] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:13.201179 21743 raft_consensus.cc:491] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:13.204044 21743 raft_consensus.cc:513] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.205204 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf52261cbf144de9a86b9f32c5ed7f0" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:13.206521 21743 leader_election.cc:290] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:13.207634 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:13.213249 21321 raft_consensus.cc:2463] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:13.208488 21241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fbf52261cbf144de9a86b9f32c5ed7f0" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:13.214531 21241 raft_consensus.cc:2388] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:13.208837 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:13.214830 21137 leader_election.cc:304] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:13.215534 21248 raft_consensus.cc:2463] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 0.
I20250109 21:10:13.215925 21751 raft_consensus.cc:2798] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:13.216457 21751 raft_consensus.cc:491] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:13.216861 21751 raft_consensus.cc:3054] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.216938 21136 leader_election.cc:304] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:13.218721 21743 raft_consensus.cc:3054] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.211186 21621 leader_election.cc:290] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:13.212208 21736 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:13.212356 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33a9dea3cbbb40abbdf4eb26e597f857" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:13.227295 21319 raft_consensus.cc:2463] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 0.
I20250109 21:10:13.228611 21214 leader_election.cc:304] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:13.230487 21621 raft_consensus.cc:2798] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:13.231037 21621 raft_consensus.cc:491] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:13.231545 21621 raft_consensus.cc:3054] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.228039 21751 raft_consensus.cc:513] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.244742 21733 raft_consensus.cc:491] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:13.245406 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:13.245261 21733 raft_consensus.cc:513] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.246156 21319 raft_consensus.cc:3054] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.247390 21733 leader_election.cc:290] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:13.247320 21241 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:13.248250 21241 raft_consensus.cc:3054] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.249372 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53" is_pre_election: true
W20250109 21:10:13.251184 21288 leader_election.cc:343] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:13.251927 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:13.252560 21242 raft_consensus.cc:2463] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 0.
I20250109 21:10:13.253540 21288 leader_election.cc:304] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:13.254582 21733 raft_consensus.cc:2798] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:13.254971 21733 raft_consensus.cc:491] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:13.255308 21733 raft_consensus.cc:3054] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.254979 21751 leader_election.cc:290] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:13.268226 21241 raft_consensus.cc:2463] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:13.279601 21136 leader_election.cc:304] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:13.282037 21736 raft_consensus.cc:2798] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:13.282516 21736 raft_consensus.cc:695] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:13.298063 21736 consensus_queue.cc:237] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.286792 21743 raft_consensus.cc:2743] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:13.292752 21365 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:13.301023 21365 ts_tablet_manager.cc:1397] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.115s user 0.018s sys 0.039s
I20250109 21:10:13.282303 21733 raft_consensus.cc:513] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.303596 21365 raft_consensus.cc:357] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.304281 21365 raft_consensus.cc:383] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:13.304091 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:13.304615 21365 raft_consensus.cc:738] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:13.297176 21319 raft_consensus.cc:2463] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 1.
I20250109 21:10:13.305261 21365 consensus_queue.cc:260] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.306713 21164 raft_consensus.cc:3054] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.308168 21365 ts_tablet_manager.cc:1428] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:13.309067 21365 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: Bootstrap starting.
I20250109 21:10:13.314842 21365 tablet_bootstrap.cc:654] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:13.273886 21621 raft_consensus.cc:513] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.320708 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33a9dea3cbbb40abbdf4eb26e597f857" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "1774487f18694af1a5340fc8486cff53"
W20250109 21:10:13.322314 21213 leader_election.cc:343] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:13.324345 21164 raft_consensus.cc:2463] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:13.326887 21621 leader_election.cc:290] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:13.326505 21288 leader_election.cc:304] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:13.328352 21730 raft_consensus.cc:2798] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:13.328899 21730 raft_consensus.cc:695] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:13.329859 21730 consensus_queue.cc:237] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.337474 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33a9dea3cbbb40abbdf4eb26e597f857" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:13.338156 21319 raft_consensus.cc:3054] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.355247 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:13.356112 21242 raft_consensus.cc:3054] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.370420 21733 leader_election.cc:290] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 1 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:13.376454 21242 raft_consensus.cc:2463] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 1.
I20250109 21:10:13.396580 21068 catalog_manager.cc:5526] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 0 to 1, leader changed from <none> to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:13.398849 21069 catalog_manager.cc:5526] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 0 to 1, leader changed from <none> to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:13.406219 21733 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:13.414562 21319 raft_consensus.cc:2463] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 1.
I20250109 21:10:13.415637 21214 leader_election.cc:304] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters: 1774487f18694af1a5340fc8486cff53
I20250109 21:10:13.416719 21699 raft_consensus.cc:2798] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:13.417299 21699 raft_consensus.cc:695] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:13.418275 21699 consensus_queue.cc:237] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.426657 21365 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: No bootstrap required, opened a new log
I20250109 21:10:13.427179 21365 ts_tablet_manager.cc:1397] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: Time spent bootstrapping tablet: real 0.118s user 0.037s sys 0.055s
I20250109 21:10:13.429021 21365 raft_consensus.cc:357] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.429538 21365 raft_consensus.cc:383] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:13.429738 21365 raft_consensus.cc:738] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Initialized, Role: FOLLOWER
I20250109 21:10:13.430240 21365 consensus_queue.cc:260] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.432166 21365 ts_tablet_manager.cc:1428] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250109 21:10:13.434412 21736 raft_consensus.cc:491] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:13.438359 21690 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.434867 21736 raft_consensus.cc:513] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.441063 21736 leader_election.cc:290] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:13.443539 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33a9dea3cbbb40abbdf4eb26e597f857" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
W20250109 21:10:13.451731 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:13.453008 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "33a9dea3cbbb40abbdf4eb26e597f857" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:13.454010 21319 raft_consensus.cc:2388] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate f5d1eaae36f84176860e3799d49e4f53 in this term.
I20250109 21:10:13.457705 21137 leader_election.cc:304] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:13.458578 21736 raft_consensus.cc:3054] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.460220 21068 catalog_manager.cc:5526] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 0 to 1, leader changed from <none> to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:13.465175 21736 raft_consensus.cc:2743] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:13.478260 21736 raft_consensus.cc:491] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:13.478714 21736 raft_consensus.cc:513] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:13.480547 21736 leader_election.cc:290] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:13.481046 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65dabcea5fff4017b727f2fcdee56246" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "f5d1eaae36f84176860e3799d49e4f53" is_pre_election: true
I20250109 21:10:13.481792 21248 raft_consensus.cc:2388] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 1774487f18694af1a5340fc8486cff53 in current term 1: Already voted for candidate 0175ef2fbd0349568ba2bf83788476ea in this term.
I20250109 21:10:13.483536 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "65dabcea5fff4017b727f2fcdee56246" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "0175ef2fbd0349568ba2bf83788476ea" is_pre_election: true
I20250109 21:10:13.484724 21137 leader_election.cc:304] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 1774487f18694af1a5340fc8486cff53; no voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:13.486613 21736 raft_consensus.cc:3054] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:13.493881 21736 raft_consensus.cc:2743] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:13.588658 21755 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.598047 21733 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.724514 21733 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.736397 21733 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.804258 21743 consensus_queue.cc:1035] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.815698 21736 consensus_queue.cc:1035] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.817261 21760 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:13.845679 21760 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250109 21:10:13.976850 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 44318.3us
W20250109 21:10:14.048424 21136 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:44109, user_credentials={real_user=slave}} blocked reactor thread for 43576.1us
I20250109 21:10:14.262799 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:14.289770 21835 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:14.290604 21833 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:14.291417 21832 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:14.292101 20003 server_base.cc:1034] running on GCE node
I20250109 21:10:14.293226 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:10:14.293498 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:14.293705 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457014293687 us; error 0 us; skew 500 ppm
I20250109 21:10:14.294327 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:14.303128 20003 webserver.cc:458] Webserver started at http://127.19.136.196:39539/ using document root <none> and password file <none>
I20250109 21:10:14.303648 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:14.303849 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:14.304162 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:14.305490 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-3-root/instance:
uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
format_stamp: "Formatted at 2025-01-09 21:10:14 on dist-test-slave-sc47"
I20250109 21:10:14.310077 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250109 21:10:14.314417 21840 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:14.315469 20003 fs_manager.cc:730] Time spent opening block manager: real 0.003s user 0.003s sys 0.000s
I20250109 21:10:14.315763 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-3-root
uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
format_stamp: "Formatted at 2025-01-09 21:10:14 on dist-test-slave-sc47"
I20250109 21:10:14.316094 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:14.348080 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:14.349823 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:14.352233 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:10:14.355206 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:10:14.355432 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:14.355860 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:10:14.356063 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:14.442507 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.196:33191
I20250109 21:10:14.442701 21907 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.196:33191 every 8 connection(s)
I20250109 21:10:14.446787 20003 auto_leader_rebalancer-test.cc:413] add a tserver: 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:14.465023 21908 heartbeater.cc:346] Connected to a master server at 127.19.136.254:44891
I20250109 21:10:14.465405 21908 heartbeater.cc:463] Registering TS with master...
I20250109 21:10:14.466085 21908 heartbeater.cc:510] Master 127.19.136.254:44891 requested a full tablet report, sending...
I20250109 21:10:14.467932 21066 ts_manager.cc:194] Registered new tserver with Master: 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191)
I20250109 21:10:14.469257 21066 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54864
I20250109 21:10:15.471714 21908 heartbeater.cc:502] Master 127.19.136.254:44891 was elected leader, sending a full tablet report...
I20250109 21:10:15.574173 21319 consensus_queue.cc:237] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:15.581638 21244 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:15.584540 21165 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:15.586753 21830 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:15.587759 21755 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:15.597592 21917 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.598822 21244 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
W20250109 21:10:15.600700 21288 consensus_peers.cc:487] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f660a562716e4048a180570218fae1d4. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:15.600905 21165 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.616230 21066 catalog_manager.cc:5526] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:15.627583 21165 consensus_queue.cc:237] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:15.638098 21244 raft_consensus.cc:1270] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:15.641120 21319 raft_consensus.cc:1270] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:15.642827 21828 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:15.644829 21828 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250109 21:10:15.655576 21136 consensus_peers.cc:487] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4a96090bb1b54bf1b35f150050e71ee7. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:15.673432 21912 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.675601 21319 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.680223 21248 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.697633 21069 catalog_manager.cc:5526] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.716751 21242 consensus_queue.cc:237] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:15.726301 21319 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:15.728004 21699 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:15.728814 21165 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:15.729959 21699 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250109 21:10:15.735960 21213 consensus_peers.cc:487] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 07149574483a42e6849046b112072921. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:15.737376 21621 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.738360 21319 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.741292 21165 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.753635 21068 catalog_manager.cc:5526] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.762138 21242 consensus_queue.cc:237] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
W20250109 21:10:15.771302 21213 consensus_peers.cc:487] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0a65a2d287ce4921be6fe0d816e85fd8. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:15.772354 21165 raft_consensus.cc:1270] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:15.773538 21937 consensus_queue.cc:1035] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:15.774271 21319 raft_consensus.cc:1270] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:15.776054 21937 consensus_queue.cc:1035] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:15.786988 21699 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.788365 21164 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.803382 21316 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:15.804329 21066 catalog_manager.cc:5526] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:16.019133 21943 ts_tablet_manager.cc:927] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:16.025005 21943 tablet_copy_client.cc:323] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:16.037024 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet f660a562716e4048a180570218fae1d4 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:16.037699 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet f660a562716e4048a180570218fae1d4 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-f660a562716e4048a180570218fae1d4
I20250109 21:10:16.044562 21334 tablet_copy_source_session.cc:215] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:16.047869 21943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f660a562716e4048a180570218fae1d4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:16.063753 21943 tablet_copy_client.cc:806] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:16.064422 21943 tablet_copy_client.cc:670] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:16.068552 21943 tablet_copy_client.cc:538] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:16.076540 21943 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:16.084292 21946 ts_tablet_manager.cc:927] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:16.092959 21946 tablet_copy_client.cc:323] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:16.102865 21182 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 4a96090bb1b54bf1b35f150050e71ee7 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:16.103456 21182 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 4a96090bb1b54bf1b35f150050e71ee7 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-4a96090bb1b54bf1b35f150050e71ee7
I20250109 21:10:16.105090 21943 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:16.105892 21943 tablet_bootstrap.cc:492] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:16.106642 21943 ts_tablet_manager.cc:1397] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.030s user 0.021s sys 0.005s
I20250109 21:10:16.109500 21943 raft_consensus.cc:357] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:16.110517 21943 raft_consensus.cc:738] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:16.111228 21182 tablet_copy_source_session.cc:215] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:16.111268 21943 consensus_queue.cc:260] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:16.114579 21943 ts_tablet_manager.cc:1428] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:16.116204 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-f660a562716e4048a180570218fae1d4 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:16.116585 21946 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4a96090bb1b54bf1b35f150050e71ee7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:16.116596 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-f660a562716e4048a180570218fae1d4 on tablet f660a562716e4048a180570218fae1d4 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:16.135293 21946 tablet_copy_client.cc:806] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:16.135808 21946 tablet_copy_client.cc:670] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:16.138850 21946 tablet_copy_client.cc:538] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:16.146492 21946 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:16.162436 21946 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:16.163172 21946 tablet_bootstrap.cc:492] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:16.163805 21946 ts_tablet_manager.cc:1397] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.017s user 0.012s sys 0.008s
I20250109 21:10:16.166420 21946 raft_consensus.cc:357] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:16.167265 21946 raft_consensus.cc:738] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:16.167747 21946 consensus_queue.cc:260] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:16.170257 21943 ts_tablet_manager.cc:927] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:16.171957 21946 ts_tablet_manager.cc:1428] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20250109 21:10:16.172729 21943 tablet_copy_client.cc:323] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:16.173861 21182 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-4a96090bb1b54bf1b35f150050e71ee7 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:16.174321 21182 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-4a96090bb1b54bf1b35f150050e71ee7 on tablet 4a96090bb1b54bf1b35f150050e71ee7 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:16.188380 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet 07149574483a42e6849046b112072921 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:16.188931 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet 07149574483a42e6849046b112072921 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-07149574483a42e6849046b112072921
I20250109 21:10:16.195379 21258 tablet_copy_source_session.cc:215] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:16.197794 21943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 07149574483a42e6849046b112072921. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:16.210553 21943 tablet_copy_client.cc:806] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:16.211074 21943 tablet_copy_client.cc:670] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:16.214951 21943 tablet_copy_client.cc:538] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:16.222421 21943 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:16.240156 21943 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:16.241091 21943 tablet_bootstrap.cc:492] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:16.241767 21943 ts_tablet_manager.cc:1397] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.019s user 0.013s sys 0.008s
I20250109 21:10:16.243983 21943 raft_consensus.cc:357] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:16.244910 21943 raft_consensus.cc:738] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:16.245561 21943 consensus_queue.cc:260] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:16.249529 21943 ts_tablet_manager.cc:1428] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:16.250707 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-07149574483a42e6849046b112072921 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:16.251077 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-07149574483a42e6849046b112072921 on tablet 07149574483a42e6849046b112072921 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:16.274784 21943 ts_tablet_manager.cc:927] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:16.276207 21943 tablet_copy_client.cc:323] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:16.277607 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet 0a65a2d287ce4921be6fe0d816e85fd8 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:16.278065 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet 0a65a2d287ce4921be6fe0d816e85fd8 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-0a65a2d287ce4921be6fe0d816e85fd8
I20250109 21:10:16.284205 21258 tablet_copy_source_session.cc:215] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:16.286839 21943 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0a65a2d287ce4921be6fe0d816e85fd8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:16.302623 21943 tablet_copy_client.cc:806] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:16.303150 21943 tablet_copy_client.cc:670] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:16.305967 21943 tablet_copy_client.cc:538] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:16.312747 21943 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:16.329056 21943 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:16.329663 21943 tablet_bootstrap.cc:492] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:16.330142 21943 ts_tablet_manager.cc:1397] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.008s
I20250109 21:10:16.332392 21943 raft_consensus.cc:357] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:16.333063 21943 raft_consensus.cc:738] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:16.333593 21943 consensus_queue.cc:260] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:16.335297 21943 ts_tablet_manager.cc:1428] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.005s user 0.008s sys 0.000s
I20250109 21:10:16.336822 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-0a65a2d287ce4921be6fe0d816e85fd8 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:16.337623 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-0a65a2d287ce4921be6fe0d816e85fd8 on tablet 0a65a2d287ce4921be6fe0d816e85fd8 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:16.449096 21881 raft_consensus.cc:1212] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:16.510277 21881 raft_consensus.cc:1212] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:16.724229 21881 raft_consensus.cc:1212] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:16.872584 21881 raft_consensus.cc:1212] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:16.943059 21956 raft_consensus.cc:1059] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:16.945238 21956 consensus_queue.cc:237] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:16.950564 21881 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:16.950848 21171 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:16.951783 21248 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:16.952320 21956 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:16.953258 21959 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:16.954197 21917 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:16.971132 21755 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:16.978113 21171 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:16.979444 21243 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:16.990130 21881 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.002694 21066 catalog_manager.cc:5526] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.023885 21912 raft_consensus.cc:1059] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:17.029882 21912 consensus_queue.cc:237] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:17.037930 21881 raft_consensus.cc:1270] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.039384 21248 raft_consensus.cc:1270] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.040609 21912 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:17.039392 21319 raft_consensus.cc:1270] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.041584 21828 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:17.044255 21831 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:17.091161 21316 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.099277 21243 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.105044 21321 consensus_queue.cc:237] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:17.109217 21957 raft_consensus.cc:1059] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:17.110692 21165 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:17.109723 21912 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.111703 21881 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:17.112887 21959 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:17.115054 21957 consensus_queue.cc:237] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:17.122550 21963 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:17.130414 21067 catalog_manager.cc:5526] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.135074 21959 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.139811 21171 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.143662 21881 raft_consensus.cc:2949] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.151859 21880 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.180532 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet f660a562716e4048a180570218fae1d4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:17.193158 21321 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.194509 21699 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:17.196547 21067 catalog_manager.cc:5526] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.207962 21171 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.210300 21975 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:17.213861 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet f660a562716e4048a180570218fae1d4 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:17.219786 21881 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.224525 21168 consensus_queue.cc:237] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:17.227241 21957 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:17.230146 21977 tablet_replica.cc:331] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:17.231281 21977 raft_consensus.cc:2238] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:17.232017 21977 raft_consensus.cc:2267] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:17.235347 21977 ts_tablet_manager.cc:1905] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:17.240693 21880 raft_consensus.cc:1270] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:17.241437 21243 raft_consensus.cc:1270] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:17.243446 21969 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:17.245150 21831 consensus_queue.cc:1035] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:17.252897 21912 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.254302 21244 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.260035 21880 raft_consensus.cc:2949] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.260516 21974 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.270680 21165 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.273988 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 4a96090bb1b54bf1b35f150050e71ee7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:17.273872 21881 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.278455 21067 catalog_manager.cc:5526] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.290699 21977 ts_tablet_manager.cc:1918] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:17.292186 21977 log.cc:1198] T f660a562716e4048a180570218fae1d4 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/f660a562716e4048a180570218fae1d4
I20250109 21:10:17.292096 21321 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.294071 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet f660a562716e4048a180570218fae1d4 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:17.312367 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 4a96090bb1b54bf1b35f150050e71ee7 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:17.311615 21066 catalog_manager.cc:5526] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.323788 21980 tablet_replica.cc:331] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:17.324828 21980 raft_consensus.cc:2238] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:17.325467 21980 raft_consensus.cc:2267] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:17.332448 21980 ts_tablet_manager.cc:1905] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:17.336819 21243 consensus_queue.cc:237] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:17.341852 21321 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:17.341854 21880 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:17.343299 21974 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:17.345283 21975 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:17.355191 21957 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.359088 21980 ts_tablet_manager.cc:1918] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:17.359535 21980 log.cc:1198] T 4a96090bb1b54bf1b35f150050e71ee7 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/4a96090bb1b54bf1b35f150050e71ee7
I20250109 21:10:17.361197 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 4a96090bb1b54bf1b35f150050e71ee7 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:17.363504 21880 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.365352 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 07149574483a42e6849046b112072921 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:17.365108 21319 raft_consensus.cc:2949] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.376309 21066 catalog_manager.cc:5526] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:17.390483 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet 07149574483a42e6849046b112072921 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:17.396663 21981 tablet_replica.cc:331] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:17.397775 21981 raft_consensus.cc:2238] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:17.398468 21981 raft_consensus.cc:2267] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:17.406224 21981 ts_tablet_manager.cc:1905] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:17.419564 21981 ts_tablet_manager.cc:1918] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:17.419965 21981 log.cc:1198] T 07149574483a42e6849046b112072921 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/07149574483a42e6849046b112072921
I20250109 21:10:17.421551 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet 07149574483a42e6849046b112072921 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:17.430467 21937 raft_consensus.cc:1059] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:17.432662 21937 consensus_queue.cc:237] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:17.441711 21321 raft_consensus.cc:1270] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.441888 21880 raft_consensus.cc:1270] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.443145 21937 consensus_queue.cc:1035] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:17.443616 21165 raft_consensus.cc:1270] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:17.444034 21957 consensus_queue.cc:1035] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:17.444905 21974 consensus_queue.cc:1035] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:17.454738 21974 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.457011 21165 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.457826 21880 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.468339 21321 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.474393 21066 catalog_manager.cc:5526] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.499454 21243 consensus_queue.cc:237] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:17.504840 21321 raft_consensus.cc:1270] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:17.504985 21880 raft_consensus.cc:1270] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:17.505944 21957 consensus_queue.cc:1035] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:17.506757 21937 consensus_queue.cc:1035] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:17.512276 21975 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.516558 21881 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.521984 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 0a65a2d287ce4921be6fe0d816e85fd8 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:17.523305 21321 raft_consensus.cc:2949] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.527877 21066 catalog_manager.cc:5526] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:17.538851 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet 0a65a2d287ce4921be6fe0d816e85fd8 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:17.539805 21981 tablet_replica.cc:331] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:17.540690 21981 raft_consensus.cc:2238] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:17.541234 21981 raft_consensus.cc:2267] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:17.543577 21981 ts_tablet_manager.cc:1905] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:17.554143 21981 ts_tablet_manager.cc:1918] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:17.554513 21981 log.cc:1198] T 0a65a2d287ce4921be6fe0d816e85fd8 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/0a65a2d287ce4921be6fe0d816e85fd8
I20250109 21:10:17.555807 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet 0a65a2d287ce4921be6fe0d816e85fd8 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:18.582106 21171 consensus_queue.cc:237] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:18.587612 21319 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:18.588151 21136 consensus_peers.cc:487] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 61283e0a72e04a589880431a717f04f3. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:18.588677 21242 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:18.588829 21987 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:18.590057 21828 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:18.596967 21987 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.599315 21319 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.604354 21242 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.615643 21066 catalog_manager.cc:5526] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:18.616674 21319 consensus_queue.cc:237] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:18.666497 21242 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:18.667166 21288 consensus_peers.cc:487] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 5bb0a4ab14fe49cd9d565ffe64396929. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:18.671314 21959 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:18.682530 21171 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:18.685487 21956 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:18.691807 21956 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.693814 21243 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.706488 21319 consensus_queue.cc:237] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:18.708806 21171 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.727381 21069 catalog_manager.cc:5526] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.751745 21243 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:18.752245 21288 consensus_peers.cc:487] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 44dc7037c0cc4926b2e36fab2a05a11a. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:18.753842 21999 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:18.757155 21171 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:18.760741 21995 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:18.763567 21959 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.766839 21243 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.785807 21067 catalog_manager.cc:5526] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.797505 21168 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.798447 21171 consensus_queue.cc:237] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:18.819978 21319 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:18.820856 21136 consensus_peers.cc:487] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8b90fd0d512143d7ba14c703e675aeaf. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:18.821184 21828 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:18.821938 21244 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:18.823230 21828 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:18.828797 21987 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.830317 21319 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.849359 21244 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:18.851586 21067 catalog_manager.cc:5526] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:19.106061 22006 ts_tablet_manager.cc:927] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:19.107885 22006 tablet_copy_client.cc:323] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:19.109414 21182 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 61283e0a72e04a589880431a717f04f3 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:19.109891 21182 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 61283e0a72e04a589880431a717f04f3 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-61283e0a72e04a589880431a717f04f3
I20250109 21:10:19.116371 21182 tablet_copy_source_session.cc:215] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:19.119836 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 61283e0a72e04a589880431a717f04f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:19.134501 22006 tablet_copy_client.cc:806] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:19.135073 22006 tablet_copy_client.cc:670] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:19.139326 22006 tablet_copy_client.cc:538] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:19.147228 22006 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:19.165100 22006 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:19.165942 22006 tablet_bootstrap.cc:492] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:19.166523 22006 ts_tablet_manager.cc:1397] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.020s user 0.009s sys 0.010s
I20250109 21:10:19.168906 22006 raft_consensus.cc:357] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:19.169744 22006 raft_consensus.cc:738] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:19.170341 22006 consensus_queue.cc:260] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:19.173363 22006 ts_tablet_manager.cc:1428] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:10:19.175302 21182 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-61283e0a72e04a589880431a717f04f3 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:19.175698 21182 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-61283e0a72e04a589880431a717f04f3 on tablet 61283e0a72e04a589880431a717f04f3 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:19.183938 22006 ts_tablet_manager.cc:927] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:19.197988 22006 tablet_copy_client.cc:323] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:19.199512 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 5bb0a4ab14fe49cd9d565ffe64396929 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:19.200001 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 5bb0a4ab14fe49cd9d565ffe64396929 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-5bb0a4ab14fe49cd9d565ffe64396929
I20250109 21:10:19.207376 21334 tablet_copy_source_session.cc:215] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:19.210203 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5bb0a4ab14fe49cd9d565ffe64396929. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:19.223328 22006 tablet_copy_client.cc:806] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:19.223882 22006 tablet_copy_client.cc:670] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:19.228549 22006 tablet_copy_client.cc:538] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:19.236131 22006 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:19.248739 22011 ts_tablet_manager.cc:927] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:19.255374 22011 tablet_copy_client.cc:323] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:19.256632 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 44dc7037c0cc4926b2e36fab2a05a11a from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:19.257184 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 44dc7037c0cc4926b2e36fab2a05a11a from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-44dc7037c0cc4926b2e36fab2a05a11a
I20250109 21:10:19.258713 22006 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:19.259380 22006 tablet_bootstrap.cc:492] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:19.259848 22006 ts_tablet_manager.cc:1397] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.024s user 0.013s sys 0.009s
I20250109 21:10:19.262496 22006 raft_consensus.cc:357] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:19.263274 21334 tablet_copy_source_session.cc:215] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:19.263288 22006 raft_consensus.cc:738] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:19.264051 22006 consensus_queue.cc:260] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:19.265707 22011 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 44dc7037c0cc4926b2e36fab2a05a11a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:19.273362 22006 ts_tablet_manager.cc:1428] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.013s user 0.007s sys 0.000s
I20250109 21:10:19.277520 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-5bb0a4ab14fe49cd9d565ffe64396929 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:19.277891 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-5bb0a4ab14fe49cd9d565ffe64396929 on tablet 5bb0a4ab14fe49cd9d565ffe64396929 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:19.285550 22011 tablet_copy_client.cc:806] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:19.286068 22011 tablet_copy_client.cc:670] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:19.289798 22011 tablet_copy_client.cc:538] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:19.290422 22006 ts_tablet_manager.cc:927] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:19.292362 22006 tablet_copy_client.cc:323] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:19.293660 21182 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 8b90fd0d512143d7ba14c703e675aeaf from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:19.294139 21182 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 8b90fd0d512143d7ba14c703e675aeaf from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-8b90fd0d512143d7ba14c703e675aeaf
I20250109 21:10:19.296928 22011 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:19.299182 21182 tablet_copy_source_session.cc:215] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:19.302596 22006 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8b90fd0d512143d7ba14c703e675aeaf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:19.318557 22006 tablet_copy_client.cc:806] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:19.319084 22006 tablet_copy_client.cc:670] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:19.324542 22006 tablet_copy_client.cc:538] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:19.326042 22011 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:19.326895 22011 tablet_bootstrap.cc:492] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:19.327535 22011 ts_tablet_manager.cc:1397] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.031s user 0.023s sys 0.008s
I20250109 21:10:19.330497 22011 raft_consensus.cc:357] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:19.331364 22011 raft_consensus.cc:738] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:19.331974 22011 consensus_queue.cc:260] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:19.332713 22006 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:19.334383 22011 ts_tablet_manager.cc:1428] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20250109 21:10:19.335870 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-44dc7037c0cc4926b2e36fab2a05a11a received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:19.336282 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-44dc7037c0cc4926b2e36fab2a05a11a on tablet 44dc7037c0cc4926b2e36fab2a05a11a with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:19.353200 22006 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:19.353823 22006 tablet_bootstrap.cc:492] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:19.354437 22006 ts_tablet_manager.cc:1397] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.022s user 0.016s sys 0.000s
I20250109 21:10:19.356513 22006 raft_consensus.cc:357] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:19.357888 22006 raft_consensus.cc:738] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:19.358407 22006 consensus_queue.cc:260] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:19.360965 22006 ts_tablet_manager.cc:1428] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:10:19.362341 21182 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-8b90fd0d512143d7ba14c703e675aeaf received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:19.362727 21182 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-8b90fd0d512143d7ba14c703e675aeaf on tablet 8b90fd0d512143d7ba14c703e675aeaf with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:19.659772 21881 raft_consensus.cc:1212] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:19.692505 21881 raft_consensus.cc:1212] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:19.720047 21881 raft_consensus.cc:1212] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:19.889986 21881 raft_consensus.cc:1212] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:20.098416 21995 raft_consensus.cc:1059] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:20.100621 21995 consensus_queue.cc:237] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:20.107576 21243 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.108887 21881 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.108785 21999 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:20.111307 21999 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.112342 21168 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.116391 21999 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.123889 22021 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.127396 21881 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.128090 21168 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.134421 21243 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.140806 21067 catalog_manager.cc:5526] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:20.158951 21321 consensus_queue.cc:237] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:20.164775 21168 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:20.166404 21995 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:20.168481 21881 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:20.169888 21999 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:20.172438 22018 raft_consensus.cc:1059] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:20.172734 21959 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.174607 22018 consensus_queue.cc:237] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:20.181713 21880 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.181732 21243 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.183094 21321 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.183765 21912 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.183276 21168 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.184661 22018 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.185496 22019 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.186492 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 5bb0a4ab14fe49cd9d565ffe64396929 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:20.196594 21068 catalog_manager.cc:5526] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:20.209134 21881 raft_consensus.cc:2949] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.216336 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet 5bb0a4ab14fe49cd9d565ffe64396929 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:20.303004 22034 tablet_replica.cc:331] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:20.309515 22019 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.332979 22021 raft_consensus.cc:1059] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:20.335357 22021 consensus_queue.cc:237] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:20.339867 21244 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.347609 21881 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.355074 21880 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.356491 22029 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.337741 21066 catalog_manager.cc:5526] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:20.366500 22034 raft_consensus.cc:2238] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:20.367216 22034 raft_consensus.cc:2267] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:20.366735 21320 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.370232 22034 ts_tablet_manager.cc:1905] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:20.371639 21168 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.374876 21243 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.377746 22021 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.379738 22021 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.386297 22034 ts_tablet_manager.cc:1918] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:20.386703 22034 log.cc:1198] T 5bb0a4ab14fe49cd9d565ffe64396929 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/5bb0a4ab14fe49cd9d565ffe64396929
I20250109 21:10:20.388195 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet 5bb0a4ab14fe49cd9d565ffe64396929 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:20.405896 21165 consensus_queue.cc:237] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:20.409678 21995 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.423053 21881 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:20.426666 21243 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:20.432361 21987 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:20.431977 21244 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.434305 22017 raft_consensus.cc:1059] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:20.436530 22017 consensus_queue.cc:237] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:20.438289 21987 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:20.437223 21068 catalog_manager.cc:5526] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:20.446071 21987 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.450889 21242 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.454332 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 61283e0a72e04a589880431a717f04f3 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:20.453560 21165 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.459813 21320 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.459811 21881 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.460742 21243 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:20.461278 22019 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.462168 22017 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.470554 22017 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:20.475214 21069 catalog_manager.cc:5526] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:20.490216 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 61283e0a72e04a589880431a717f04f3 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:20.496876 22045 tablet_replica.cc:331] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:20.500444 22045 raft_consensus.cc:2238] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:20.495540 21880 raft_consensus.cc:2949] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.502169 21879 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.505532 21912 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.518457 21316 consensus_queue.cc:237] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:20.518414 21320 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.522889 21879 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:20.506470 22045 raft_consensus.cc:2267] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:20.527220 21171 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:20.525063 21880 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.527365 21995 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:20.533011 21995 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:20.539660 22029 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.541782 21066 catalog_manager.cc:5526] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:20.545770 21242 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.547111 22045 ts_tablet_manager.cc:1905] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:20.559270 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 44dc7037c0cc4926b2e36fab2a05a11a with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:20.563745 21165 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.576354 21880 raft_consensus.cc:2949] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.582332 21165 consensus_queue.cc:237] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:20.584941 22045 ts_tablet_manager.cc:1918] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:20.590075 22045 log.cc:1198] T 61283e0a72e04a589880431a717f04f3 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/61283e0a72e04a589880431a717f04f3
I20250109 21:10:20.595706 21879 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:20.597009 21248 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:20.598728 21912 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:20.599666 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 61283e0a72e04a589880431a717f04f3 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:20.601599 21068 catalog_manager.cc:5526] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:20.603926 21987 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:20.614763 22017 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.623459 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet 44dc7037c0cc4926b2e36fab2a05a11a with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:20.624338 22034 tablet_replica.cc:331] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:20.626744 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 8b90fd0d512143d7ba14c703e675aeaf with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:20.626448 21244 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.629400 21879 raft_consensus.cc:2949] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.645344 22034 raft_consensus.cc:2238] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:20.646114 22034 raft_consensus.cc:2267] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:20.647080 21066 catalog_manager.cc:5526] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:20.650684 22034 ts_tablet_manager.cc:1905] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:20.655930 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 8b90fd0d512143d7ba14c703e675aeaf with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:20.656838 22045 tablet_replica.cc:331] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:20.657586 22045 raft_consensus.cc:2238] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:20.658116 22045 raft_consensus.cc:2267] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:20.661804 22045 ts_tablet_manager.cc:1905] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:20.667196 22034 ts_tablet_manager.cc:1918] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:20.668414 22034 log.cc:1198] T 44dc7037c0cc4926b2e36fab2a05a11a P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/44dc7037c0cc4926b2e36fab2a05a11a
I20250109 21:10:20.669821 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet 44dc7037c0cc4926b2e36fab2a05a11a (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:20.675524 22045 ts_tablet_manager.cc:1918] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:20.675824 22045 log.cc:1198] T 8b90fd0d512143d7ba14c703e675aeaf P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/8b90fd0d512143d7ba14c703e675aeaf
I20250109 21:10:20.676909 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 8b90fd0d512143d7ba14c703e675aeaf (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:21.703889 21320 consensus_queue.cc:237] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:21.711550 21244 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:21.714155 21288 consensus_peers.cc:487] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 1fa09aa7e53c4ba9a22836b10b7a8446. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:21.714160 21165 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:21.714264 21959 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:21.716017 22048 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:21.725839 22048 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.730379 21171 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.733234 21244 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.744242 21165 consensus_queue.cc:237] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:21.745981 21065 catalog_manager.cc:5526] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.753471 21320 raft_consensus.cc:1270] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:21.754859 22017 consensus_queue.cc:1035] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:21.755515 21244 raft_consensus.cc:1270] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:21.755957 21136 consensus_peers.cc:487] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 2963062e448e46b3b27c83dd6c77b956. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:21.757109 21912 consensus_queue.cc:1035] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:21.768358 21248 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.770730 21912 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.779428 21320 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.784688 21316 consensus_queue.cc:237] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:21.792985 21248 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:21.794482 21959 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:21.795260 21165 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:21.798163 21288 consensus_peers.cc:487] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9add3f091006404a8cbf90aef76b0c5d. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:21.799710 22048 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:21.809787 21066 catalog_manager.cc:5526] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.816169 22048 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.819288 21248 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.826169 21165 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.842667 21171 consensus_queue.cc:237] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:21.844357 21065 catalog_manager.cc:5526] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:21.850342 21316 raft_consensus.cc:1270] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:21.850932 21136 consensus_peers.cc:487] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 73f91268c8384e79a83979ffd1c00d99. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:21.851825 21912 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:21.853204 21248 raft_consensus.cc:1270] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:21.854756 21912 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:21.863173 22058 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.864320 21244 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.866554 21320 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:21.885128 21066 catalog_manager.cc:5526] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:22.248924 22067 ts_tablet_manager.cc:927] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:22.250993 22067 tablet_copy_client.cc:323] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:22.254259 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 9add3f091006404a8cbf90aef76b0c5d from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:22.254729 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 9add3f091006404a8cbf90aef76b0c5d from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-9add3f091006404a8cbf90aef76b0c5d
I20250109 21:10:22.261940 22069 ts_tablet_manager.cc:927] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:22.262076 21334 tablet_copy_source_session.cc:215] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:22.264804 22067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9add3f091006404a8cbf90aef76b0c5d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:22.270807 22069 tablet_copy_client.cc:323] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:22.272238 21182 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 73f91268c8384e79a83979ffd1c00d99 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:22.272739 21182 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 73f91268c8384e79a83979ffd1c00d99 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-73f91268c8384e79a83979ffd1c00d99
I20250109 21:10:22.280941 22067 tablet_copy_client.cc:806] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:22.281451 22067 tablet_copy_client.cc:670] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:22.282310 21182 tablet_copy_source_session.cc:215] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:22.283567 22071 ts_tablet_manager.cc:927] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:22.285347 22069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 73f91268c8384e79a83979ffd1c00d99. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:22.285820 22071 tablet_copy_client.cc:323] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:22.285574 22067 tablet_copy_client.cc:538] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:22.287168 21182 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 2963062e448e46b3b27c83dd6c77b956 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:22.287565 21182 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 2963062e448e46b3b27c83dd6c77b956 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-2963062e448e46b3b27c83dd6c77b956
I20250109 21:10:22.293831 22067 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:22.298207 21182 tablet_copy_source_session.cc:215] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:22.301949 22071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2963062e448e46b3b27c83dd6c77b956. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:22.306098 22069 tablet_copy_client.cc:806] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:22.306648 22069 tablet_copy_client.cc:670] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:22.311367 22069 tablet_copy_client.cc:538] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:22.319861 22067 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:22.320688 22067 tablet_bootstrap.cc:492] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:22.321213 22074 ts_tablet_manager.cc:927] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:22.321375 22067 ts_tablet_manager.cc:1397] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.028s user 0.020s sys 0.008s
I20250109 21:10:22.322678 22069 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:22.325373 22067 raft_consensus.cc:357] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:22.326239 22071 tablet_copy_client.cc:806] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:22.326982 22071 tablet_copy_client.cc:670] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:22.326241 22067 raft_consensus.cc:738] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:22.327951 22074 tablet_copy_client.cc:323] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:22.328305 22067 consensus_queue.cc:260] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:22.329703 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 1fa09aa7e53c4ba9a22836b10b7a8446 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:22.330195 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 1fa09aa7e53c4ba9a22836b10b7a8446 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-1fa09aa7e53c4ba9a22836b10b7a8446
I20250109 21:10:22.331250 22071 tablet_copy_client.cc:538] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:22.339713 21334 tablet_copy_source_session.cc:215] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:22.343036 22074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1fa09aa7e53c4ba9a22836b10b7a8446. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:22.351204 22071 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:22.356598 22067 ts_tablet_manager.cc:1428] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.034s user 0.007s sys 0.023s
I20250109 21:10:22.358690 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-9add3f091006404a8cbf90aef76b0c5d received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:22.359117 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-9add3f091006404a8cbf90aef76b0c5d on tablet 9add3f091006404a8cbf90aef76b0c5d with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:22.375563 22074 tablet_copy_client.cc:806] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:22.376158 22074 tablet_copy_client.cc:670] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:22.380780 22074 tablet_copy_client.cc:538] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:22.381129 22069 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:22.381404 22071 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:22.382293 22069 tablet_bootstrap.cc:492] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:22.382293 22071 tablet_bootstrap.cc:492] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:22.383215 22071 ts_tablet_manager.cc:1397] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.032s user 0.013s sys 0.011s
I20250109 21:10:22.383183 22069 ts_tablet_manager.cc:1397] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.061s user 0.027s sys 0.010s
I20250109 21:10:22.389297 22069 raft_consensus.cc:357] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:22.390161 22069 raft_consensus.cc:738] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:22.389443 22071 raft_consensus.cc:357] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:22.391062 22071 raft_consensus.cc:738] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:22.391129 22069 consensus_queue.cc:260] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:22.391752 22071 consensus_queue.cc:260] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:22.394044 22069 ts_tablet_manager.cc:1428] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250109 21:10:22.394039 22071 ts_tablet_manager.cc:1428] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.010s user 0.004s sys 0.001s
I20250109 21:10:22.396811 21182 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-73f91268c8384e79a83979ffd1c00d99 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:22.397202 21182 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-73f91268c8384e79a83979ffd1c00d99 on tablet 73f91268c8384e79a83979ffd1c00d99 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:22.398182 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-2963062e448e46b3b27c83dd6c77b956 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:22.398573 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-2963062e448e46b3b27c83dd6c77b956 on tablet 2963062e448e46b3b27c83dd6c77b956 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:22.403786 22074 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:22.421684 22074 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:22.423025 22074 tablet_bootstrap.cc:492] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:22.423601 22074 ts_tablet_manager.cc:1397] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.020s user 0.011s sys 0.007s
I20250109 21:10:22.427403 22074 raft_consensus.cc:357] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:22.428262 22074 raft_consensus.cc:738] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:22.428871 22074 consensus_queue.cc:260] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:22.431293 22074 ts_tablet_manager.cc:1428] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250109 21:10:22.432639 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-1fa09aa7e53c4ba9a22836b10b7a8446 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:22.433043 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-1fa09aa7e53c4ba9a22836b10b7a8446 on tablet 1fa09aa7e53c4ba9a22836b10b7a8446 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:22.737341 21879 raft_consensus.cc:1212] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:22.799806 21879 raft_consensus.cc:1212] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:22.890805 21879 raft_consensus.cc:1212] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:22.928664 21879 raft_consensus.cc:1212] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:23.190371 21912 raft_consensus.cc:1059] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:23.192103 21912 consensus_queue.cc:237] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:23.198190 21879 raft_consensus.cc:1270] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.199388 21248 raft_consensus.cc:1270] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.201177 21316 raft_consensus.cc:1270] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.200640 22083 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:23.202059 22080 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.202863 21912 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.218190 21912 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.219808 21248 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.239889 21881 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.242480 21320 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.238806 21068 catalog_manager.cc:5526] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:23.247751 21995 raft_consensus.cc:1059] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:23.249816 21995 consensus_queue.cc:237] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:23.272812 21248 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.274875 21165 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.275269 21881 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.274969 22081 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:23.277024 22051 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.288203 21995 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:23.305467 22081 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.311648 21168 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.316823 21165 consensus_queue.cc:237] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:23.320721 21881 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.322161 21248 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.327708 21879 raft_consensus.cc:1270] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:23.329152 22058 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:23.331764 21244 raft_consensus.cc:1270] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:23.332687 21066 catalog_manager.cc:5526] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.333525 22058 consensus_queue.cc:1035] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:23.344611 21248 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.345253 22058 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.351351 21881 raft_consensus.cc:2949] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.356113 21320 consensus_queue.cc:237] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:23.361173 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 73f91268c8384e79a83979ffd1c00d99 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:23.360420 21068 catalog_manager.cc:5526] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.371601 21244 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:23.373731 21995 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:23.378038 21881 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:23.379245 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 73f91268c8384e79a83979ffd1c00d99 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:23.379351 21995 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:23.383713 22081 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.384723 21248 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.392890 22095 tablet_replica.cc:331] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:23.393860 22095 raft_consensus.cc:2238] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:23.396315 21912 raft_consensus.cc:1059] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:23.397889 21912 consensus_queue.cc:237] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:23.399022 21881 raft_consensus.cc:2949] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.400313 22095 raft_consensus.cc:2267] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:23.408967 22095 ts_tablet_manager.cc:1905] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:23.412140 21879 raft_consensus.cc:1270] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.413872 21248 raft_consensus.cc:1270] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.412369 21316 raft_consensus.cc:1270] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.415066 22083 consensus_queue.cc:1035] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.416275 22080 consensus_queue.cc:1035] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.417078 22083 consensus_queue.cc:1035] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.416740 21069 catalog_manager.cc:5526] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.428491 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 9add3f091006404a8cbf90aef76b0c5d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:23.448524 21881 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.449024 22080 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.466557 22095 ts_tablet_manager.cc:1918] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:23.466881 22095 log.cc:1198] T 73f91268c8384e79a83979ffd1c00d99 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/73f91268c8384e79a83979ffd1c00d99
I20250109 21:10:23.467422 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet 9add3f091006404a8cbf90aef76b0c5d with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:23.471593 21248 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.478385 22101 tablet_replica.cc:331] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:23.479449 22101 raft_consensus.cc:2238] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:23.480017 22101 raft_consensus.cc:2267] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:23.473325 21069 catalog_manager.cc:5526] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.485998 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 73f91268c8384e79a83979ffd1c00d99 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:23.475446 21320 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.487440 22101 ts_tablet_manager.cc:1905] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:23.502791 22101 ts_tablet_manager.cc:1918] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:23.503382 22101 log.cc:1198] T 9add3f091006404a8cbf90aef76b0c5d P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/9add3f091006404a8cbf90aef76b0c5d
I20250109 21:10:23.508276 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet 9add3f091006404a8cbf90aef76b0c5d (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:23.517374 21168 consensus_queue.cc:237] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:23.522656 21881 raft_consensus.cc:1270] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:23.524070 21320 raft_consensus.cc:1270] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:23.524833 22058 consensus_queue.cc:1035] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.003s
I20250109 21:10:23.527829 22080 consensus_queue.cc:1035] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:23.533833 22080 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.537464 21881 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.539173 21316 raft_consensus.cc:2949] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.543572 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 2963062e448e46b3b27c83dd6c77b956 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:23.554044 22051 raft_consensus.cc:1059] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:23.556262 22051 consensus_queue.cc:237] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:23.566517 21242 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.566800 21879 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.565449 21069 catalog_manager.cc:5526] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.568127 21995 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.569033 21165 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:23.571107 21995 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.574100 21995 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:23.599223 22081 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.603824 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet 2963062e448e46b3b27c83dd6c77b956 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:23.611528 21879 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.618669 22106 tablet_replica.cc:331] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:23.619459 22106 raft_consensus.cc:2238] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:23.628484 21069 catalog_manager.cc:5526] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.632182 21242 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.632555 21165 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.635248 22106 raft_consensus.cc:2267] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:23.650487 22106 ts_tablet_manager.cc:1905] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:23.658109 21320 consensus_queue.cc:237] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:23.662683 21879 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:23.663388 21242 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:23.664050 22097 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:23.664989 22081 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:23.671391 22097 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.673058 21248 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.674357 22106 ts_tablet_manager.cc:1918] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:23.674767 22106 log.cc:1198] T 2963062e448e46b3b27c83dd6c77b956 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/2963062e448e46b3b27c83dd6c77b956
I20250109 21:10:23.676563 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet 2963062e448e46b3b27c83dd6c77b956 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:23.676751 21879 raft_consensus.cc:2949] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.692118 21065 catalog_manager.cc:5526] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:23.695377 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 1fa09aa7e53c4ba9a22836b10b7a8446 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:23.704615 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet 1fa09aa7e53c4ba9a22836b10b7a8446 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:23.705359 22101 tablet_replica.cc:331] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:23.706318 22101 raft_consensus.cc:2238] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:23.706897 22101 raft_consensus.cc:2267] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:23.709512 22101 ts_tablet_manager.cc:1905] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:23.726241 22101 ts_tablet_manager.cc:1918] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:23.726502 22101 log.cc:1198] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/1fa09aa7e53c4ba9a22836b10b7a8446
I20250109 21:10:23.727489 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet 1fa09aa7e53c4ba9a22836b10b7a8446 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:24.765990 21165 consensus_queue.cc:237] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:24.775008 21320 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:24.776295 21136 consensus_peers.cc:487] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c77aca60924f40f68ecc7531984ef0cc. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:24.776495 22058 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:24.778455 21248 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:24.780124 22109 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:24.788374 21912 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.789479 21248 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.790483 21320 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.805195 21069 catalog_manager.cc:5526] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:24.808238 21321 consensus_queue.cc:237] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:24.819203 21242 raft_consensus.cc:1270] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:24.823150 22097 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.003s
I20250109 21:10:24.825767 21165 raft_consensus.cc:1270] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:24.834758 21288 consensus_peers.cc:487] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: fbf52261cbf144de9a86b9f32c5ed7f0. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:24.837114 22097 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:24.851500 21995 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.852773 21165 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.860869 21242 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.878544 21065 catalog_manager.cc:5526] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.880714 21171 consensus_queue.cc:237] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
W20250109 21:10:24.889217 21136 consensus_peers.cc:487] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 9fa9778f2eb54207aea2f47f9037b443. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:24.889958 21248 raft_consensus.cc:1270] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:24.892388 21320 raft_consensus.cc:1270] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:24.893635 22109 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:24.894937 21912 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:24.904101 22109 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.905767 21242 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.908982 21320 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.927304 21066 catalog_manager.cc:5526] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.929289 21320 consensus_queue.cc:237] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:24.941715 21242 raft_consensus.cc:1270] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:24.943786 21171 raft_consensus.cc:1270] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:24.945243 21288 consensus_peers.cc:487] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 35869458d4934257a5392c4158bc4cd1. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:24.946027 21995 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:24.947247 22097 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:24.957830 22119 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.959560 21242 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.970479 21171 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:24.973551 21065 catalog_manager.cc:5526] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:25.236802 22126 ts_tablet_manager.cc:927] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:25.239372 22126 tablet_copy_client.cc:323] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:25.241214 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet fbf52261cbf144de9a86b9f32c5ed7f0 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:25.241792 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet fbf52261cbf144de9a86b9f32c5ed7f0 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-fbf52261cbf144de9a86b9f32c5ed7f0
I20250109 21:10:25.248035 21334 tablet_copy_source_session.cc:215] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:25.251101 22126 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fbf52261cbf144de9a86b9f32c5ed7f0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:25.264963 22126 tablet_copy_client.cc:806] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:25.265663 22126 tablet_copy_client.cc:670] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:25.268821 22126 tablet_copy_client.cc:538] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:25.277410 22126 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:25.298475 22126 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:25.299619 22126 tablet_bootstrap.cc:492] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:25.300347 22126 ts_tablet_manager.cc:1397] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.023s user 0.017s sys 0.004s
I20250109 21:10:25.302937 22126 raft_consensus.cc:357] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:25.303867 22126 raft_consensus.cc:738] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:25.304580 22126 consensus_queue.cc:260] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:25.307047 22126 ts_tablet_manager.cc:1428] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20250109 21:10:25.307873 22129 ts_tablet_manager.cc:927] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:25.310293 22129 tablet_copy_client.cc:323] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:25.311980 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet c77aca60924f40f68ecc7531984ef0cc from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:25.312522 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet c77aca60924f40f68ecc7531984ef0cc from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-c77aca60924f40f68ecc7531984ef0cc
I20250109 21:10:25.312819 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-fbf52261cbf144de9a86b9f32c5ed7f0 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:25.313274 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-fbf52261cbf144de9a86b9f32c5ed7f0 on tablet fbf52261cbf144de9a86b9f32c5ed7f0 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:25.320137 21181 tablet_copy_source_session.cc:215] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:25.322916 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c77aca60924f40f68ecc7531984ef0cc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:25.337884 22129 tablet_copy_client.cc:806] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:25.338402 22129 tablet_copy_client.cc:670] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:25.341374 22129 tablet_copy_client.cc:538] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:25.348512 22129 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:25.364952 22129 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:25.365731 22129 tablet_bootstrap.cc:492] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:25.366382 22129 ts_tablet_manager.cc:1397] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.018s user 0.008s sys 0.010s
I20250109 21:10:25.368757 22129 raft_consensus.cc:357] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:25.369616 22129 raft_consensus.cc:738] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:25.370285 22129 consensus_queue.cc:260] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:25.372876 22129 ts_tablet_manager.cc:1428] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:10:25.374326 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-c77aca60924f40f68ecc7531984ef0cc received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:25.374748 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-c77aca60924f40f68ecc7531984ef0cc on tablet c77aca60924f40f68ecc7531984ef0cc with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:25.414479 22129 ts_tablet_manager.cc:927] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:25.416615 22129 tablet_copy_client.cc:323] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:25.418190 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 9fa9778f2eb54207aea2f47f9037b443 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:25.418655 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 9fa9778f2eb54207aea2f47f9037b443 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-9fa9778f2eb54207aea2f47f9037b443
I20250109 21:10:25.424721 21181 tablet_copy_source_session.cc:215] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:25.427138 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9fa9778f2eb54207aea2f47f9037b443. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:25.438145 22129 tablet_copy_client.cc:806] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:25.438669 22129 tablet_copy_client.cc:670] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:25.442900 22129 tablet_copy_client.cc:538] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:25.449733 22129 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:25.486452 22129 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:25.487303 22129 tablet_bootstrap.cc:492] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:25.487800 22129 ts_tablet_manager.cc:1397] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.038s user 0.005s sys 0.024s
I20250109 21:10:25.489938 22129 raft_consensus.cc:357] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:25.490957 22129 raft_consensus.cc:738] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:25.491578 22129 consensus_queue.cc:260] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:25.493961 22129 ts_tablet_manager.cc:1428] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.000s sys 0.004s
I20250109 21:10:25.495451 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-9fa9778f2eb54207aea2f47f9037b443 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:25.495847 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-9fa9778f2eb54207aea2f47f9037b443 on tablet 9fa9778f2eb54207aea2f47f9037b443 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:25.561534 22129 ts_tablet_manager.cc:927] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:25.563652 22129 tablet_copy_client.cc:323] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:25.565730 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 35869458d4934257a5392c4158bc4cd1 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:25.566205 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 35869458d4934257a5392c4158bc4cd1 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-35869458d4934257a5392c4158bc4cd1
I20250109 21:10:25.573314 21334 tablet_copy_source_session.cc:215] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:25.575908 22129 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35869458d4934257a5392c4158bc4cd1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:25.589123 22129 tablet_copy_client.cc:806] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:25.589710 22129 tablet_copy_client.cc:670] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:25.592691 22129 tablet_copy_client.cc:538] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:25.600338 22129 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:25.617326 22129 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:25.618088 22129 tablet_bootstrap.cc:492] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:25.618569 22129 ts_tablet_manager.cc:1397] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.018s user 0.004s sys 0.013s
I20250109 21:10:25.620812 22129 raft_consensus.cc:357] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:25.621313 22129 raft_consensus.cc:738] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:25.621752 22129 consensus_queue.cc:260] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:25.623562 22129 ts_tablet_manager.cc:1428] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20250109 21:10:25.625104 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-35869458d4934257a5392c4158bc4cd1 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:25.625444 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-35869458d4934257a5392c4158bc4cd1 on tablet 35869458d4934257a5392c4158bc4cd1 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:25.716778 21881 raft_consensus.cc:1212] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:25.824348 21881 raft_consensus.cc:1212] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:25.954339 21881 raft_consensus.cc:1212] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:26.023299 21881 raft_consensus.cc:1212] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:26.223181 22137 raft_consensus.cc:1059] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:26.225139 22137 consensus_queue.cc:237] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:26.231295 21881 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.231436 21248 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.231648 21316 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.233120 22058 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.233882 22109 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.234702 22137 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.245545 22137 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.247462 21320 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.250463 21248 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.262981 21881 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.265396 21066 catalog_manager.cc:5526] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:26.298189 21165 consensus_queue.cc:237] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:26.310628 21881 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:26.311530 21316 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:26.312151 22058 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:26.314318 22058 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:26.320055 22137 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.321830 21316 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.327824 21881 raft_consensus.cc:2949] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.332769 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet c77aca60924f40f68ecc7531984ef0cc with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:26.336406 21065 catalog_manager.cc:5526] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:26.348922 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet c77aca60924f40f68ecc7531984ef0cc with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:26.365044 22148 tablet_replica.cc:331] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:26.366012 22148 raft_consensus.cc:2238] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:26.366559 22148 raft_consensus.cc:2267] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:26.369437 22148 ts_tablet_manager.cc:1905] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:26.382683 22148 ts_tablet_manager.cc:1918] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:26.383080 22148 log.cc:1198] T c77aca60924f40f68ecc7531984ef0cc P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/c77aca60924f40f68ecc7531984ef0cc
I20250109 21:10:26.384953 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet c77aca60924f40f68ecc7531984ef0cc (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:26.391790 22143 raft_consensus.cc:1059] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:26.393775 22143 consensus_queue.cc:237] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:26.401984 21242 raft_consensus.cc:1270] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.402242 21171 raft_consensus.cc:1270] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.403260 21881 raft_consensus.cc:1270] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.403604 22150 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.404477 21995 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.406462 21995 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.419025 22097 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.420920 21881 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.425032 21242 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.427667 22119 raft_consensus.cc:1059] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:26.429867 22119 consensus_queue.cc:237] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:26.440003 21165 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.443763 21242 raft_consensus.cc:1270] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.443902 21168 raft_consensus.cc:1270] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.445015 22119 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:26.446101 21995 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.444972 21069 catalog_manager.cc:5526] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.464092 21321 consensus_queue.cc:237] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:26.482710 21880 raft_consensus.cc:1270] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:26.482882 21244 raft_consensus.cc:1270] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:26.484601 22097 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:26.485796 21881 raft_consensus.cc:1270] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.485954 22097 consensus_queue.cc:1035] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:26.489612 22097 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.506142 22119 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.514298 21881 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.519089 21243 raft_consensus.cc:2949] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.524695 22143 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.526434 21066 catalog_manager.cc:5526] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.532696 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet fbf52261cbf144de9a86b9f32c5ed7f0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:26.543175 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet fbf52261cbf144de9a86b9f32c5ed7f0 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:26.547178 22158 tablet_replica.cc:331] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:26.548203 22158 raft_consensus.cc:2238] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:26.548938 22158 raft_consensus.cc:2267] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:26.547483 21171 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.552490 22158 ts_tablet_manager.cc:1905] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:26.556720 21243 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.564754 21069 catalog_manager.cc:5526] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:26.567677 21880 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.584637 22109 raft_consensus.cc:1059] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:26.586234 22109 consensus_queue.cc:237] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:26.599993 22158 ts_tablet_manager.cc:1918] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:26.600505 22158 log.cc:1198] T fbf52261cbf144de9a86b9f32c5ed7f0 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/fbf52261cbf144de9a86b9f32c5ed7f0
I20250109 21:10:26.605849 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet fbf52261cbf144de9a86b9f32c5ed7f0 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:26.606812 21880 raft_consensus.cc:1270] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.607329 21243 raft_consensus.cc:1270] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.608556 22137 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.610401 22058 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:26.614782 21321 raft_consensus.cc:1270] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:26.617374 21320 consensus_queue.cc:237] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:26.623952 21881 raft_consensus.cc:1270] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:26.623097 22109 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20250109 21:10:26.627040 22143 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:26.629590 21171 raft_consensus.cc:1270] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:26.641047 22143 consensus_queue.cc:1035] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:26.652957 21995 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.654570 21168 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.656822 21881 raft_consensus.cc:2949] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.663434 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 35869458d4934257a5392c4158bc4cd1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:26.672286 21069 catalog_manager.cc:5526] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.675660 22109 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.683315 21881 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.686129 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet 35869458d4934257a5392c4158bc4cd1 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:26.691092 22148 tablet_replica.cc:331] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:26.692350 22148 raft_consensus.cc:2238] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:26.693030 22148 raft_consensus.cc:2267] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:26.693207 21316 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.706768 21243 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.704965 22148 ts_tablet_manager.cc:1905] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:26.712067 21066 catalog_manager.cc:5526] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.727275 22148 ts_tablet_manager.cc:1918] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:26.728005 22148 log.cc:1198] T 35869458d4934257a5392c4158bc4cd1 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/35869458d4934257a5392c4158bc4cd1
I20250109 21:10:26.729157 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet 35869458d4934257a5392c4158bc4cd1 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:26.749011 21165 consensus_queue.cc:237] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:26.758366 21881 raft_consensus.cc:1270] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:26.759554 22109 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:26.760020 21243 raft_consensus.cc:1270] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:26.761662 22058 consensus_queue.cc:1035] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:26.768236 22160 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.768955 21242 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.768882 21881 raft_consensus.cc:2949] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.783022 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 9fa9778f2eb54207aea2f47f9037b443 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:26.783797 21065 catalog_manager.cc:5526] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:26.800318 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 9fa9778f2eb54207aea2f47f9037b443 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:26.804312 22165 tablet_replica.cc:331] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:26.805330 22165 raft_consensus.cc:2238] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:26.806102 22165 raft_consensus.cc:2267] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:26.810194 22165 ts_tablet_manager.cc:1905] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:26.822217 22165 ts_tablet_manager.cc:1918] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:26.822546 22165 log.cc:1198] T 9fa9778f2eb54207aea2f47f9037b443 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/9fa9778f2eb54207aea2f47f9037b443
I20250109 21:10:26.823912 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 9fa9778f2eb54207aea2f47f9037b443 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:27.866724 21242 consensus_queue.cc:237] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:27.872769 21165 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:27.873395 21213 consensus_peers.cc:487] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c714104a3f784fa2a8dbab3a26b67e16. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:27.874125 21321 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:27.874405 22166 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:27.875284 22046 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:27.881896 22046 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.883190 21321 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.883522 21165 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.896005 21069 catalog_manager.cc:5526] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:27.903666 21165 consensus_queue.cc:237] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
W20250109 21:10:27.911478 21136 consensus_peers.cc:487] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8d059ec48cb46dfac04405794b984ee. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:27.912732 21242 raft_consensus.cc:1270] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:27.913988 22058 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:27.910771 21316 raft_consensus.cc:1270] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:27.916160 22058 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:27.926174 22163 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.927623 21316 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.931779 21242 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.943253 21065 catalog_manager.cc:5526] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.950863 21165 consensus_queue.cc:237] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:27.957916 21321 raft_consensus.cc:1270] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:27.958231 21242 raft_consensus.cc:1270] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:27.958408 21136 consensus_peers.cc:487] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 4271f4a728084e65b74f13aa9fa0c6c0. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:27.959213 22058 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:27.960354 22163 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:27.967751 22058 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.969455 21321 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.970371 21243 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.981518 21321 consensus_queue.cc:237] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:27.985852 21069 catalog_manager.cc:5526] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:27.988731 21242 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:27.992173 21288 consensus_peers.cc:487] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7a4ca66c3087428aaf05f37bc1ba32ee. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:27.996049 21165 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:27.996253 22167 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:27.997447 22150 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:28.006253 22167 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:28.007503 21242 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:28.008031 21165 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:28.022337 21065 catalog_manager.cc:5526] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:28.427013 22186 ts_tablet_manager.cc:927] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:28.427824 22187 ts_tablet_manager.cc:927] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:28.429054 22186 tablet_copy_client.cc:323] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:28.429792 22187 tablet_copy_client.cc:323] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:28.431185 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet c714104a3f784fa2a8dbab3a26b67e16 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:28.431702 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet c714104a3f784fa2a8dbab3a26b67e16 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-c714104a3f784fa2a8dbab3a26b67e16
I20250109 21:10:28.431785 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet f8d059ec48cb46dfac04405794b984ee from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:28.432387 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet f8d059ec48cb46dfac04405794b984ee from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-f8d059ec48cb46dfac04405794b984ee
I20250109 21:10:28.439952 21258 tablet_copy_source_session.cc:215] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:28.440901 21181 tablet_copy_source_session.cc:215] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:28.442849 22186 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c714104a3f784fa2a8dbab3a26b67e16. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:28.443615 22187 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8d059ec48cb46dfac04405794b984ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:28.457911 22186 tablet_copy_client.cc:806] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:28.458475 22186 tablet_copy_client.cc:670] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:28.459595 22187 tablet_copy_client.cc:806] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:28.460115 22187 tablet_copy_client.cc:670] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:28.462401 22186 tablet_copy_client.cc:538] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:28.463677 22187 tablet_copy_client.cc:538] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:28.469672 22186 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:28.472084 22187 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:28.486246 22190 ts_tablet_manager.cc:927] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:28.490887 22193 ts_tablet_manager.cc:927] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:28.491919 22190 tablet_copy_client.cc:323] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:28.493388 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 4271f4a728084e65b74f13aa9fa0c6c0 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:28.493920 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 4271f4a728084e65b74f13aa9fa0c6c0 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-4271f4a728084e65b74f13aa9fa0c6c0
I20250109 21:10:28.502362 22193 tablet_copy_client.cc:323] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:28.503271 21181 tablet_copy_source_session.cc:215] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:28.503902 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 7a4ca66c3087428aaf05f37bc1ba32ee from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:28.504459 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 7a4ca66c3087428aaf05f37bc1ba32ee from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-7a4ca66c3087428aaf05f37bc1ba32ee
I20250109 21:10:28.506065 22190 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4271f4a728084e65b74f13aa9fa0c6c0. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:28.507869 22186 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:28.508430 22186 tablet_bootstrap.cc:492] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:28.508908 22186 ts_tablet_manager.cc:1397] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.039s user 0.021s sys 0.001s
I20250109 21:10:28.511165 21334 tablet_copy_source_session.cc:215] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:28.511359 22186 raft_consensus.cc:357] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:28.512254 22186 raft_consensus.cc:738] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:28.512988 22186 consensus_queue.cc:260] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:28.514089 22193 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7a4ca66c3087428aaf05f37bc1ba32ee. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:28.519798 22186 ts_tablet_manager.cc:1428] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.011s user 0.007s sys 0.004s
I20250109 21:10:28.524817 22187 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:28.525312 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-c714104a3f784fa2a8dbab3a26b67e16 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:28.525645 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-c714104a3f784fa2a8dbab3a26b67e16 on tablet c714104a3f784fa2a8dbab3a26b67e16 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:28.526252 22190 tablet_copy_client.cc:806] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:28.528592 22187 tablet_bootstrap.cc:492] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:28.537204 22190 tablet_copy_client.cc:670] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:28.536751 22193 tablet_copy_client.cc:806] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:28.537541 22187 ts_tablet_manager.cc:1397] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.066s user 0.018s sys 0.018s
I20250109 21:10:28.537858 22193 tablet_copy_client.cc:670] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:28.540166 22187 raft_consensus.cc:357] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:28.540961 22187 raft_consensus.cc:738] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:28.541322 22190 tablet_copy_client.cc:538] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:28.541574 22187 consensus_queue.cc:260] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:28.544080 22187 ts_tablet_manager.cc:1428] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.002s sys 0.003s
I20250109 21:10:28.545711 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-f8d059ec48cb46dfac04405794b984ee received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:28.546106 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-f8d059ec48cb46dfac04405794b984ee on tablet f8d059ec48cb46dfac04405794b984ee with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:28.548764 22193 tablet_copy_client.cc:538] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:28.556260 22193 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:28.561064 22190 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:28.580385 22190 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:28.581388 22190 tablet_bootstrap.cc:492] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:28.582027 22190 ts_tablet_manager.cc:1397] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.021s user 0.016s sys 0.005s
I20250109 21:10:28.583585 22193 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:28.584463 22193 tablet_bootstrap.cc:492] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:28.585026 22193 ts_tablet_manager.cc:1397] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.029s user 0.012s sys 0.008s
I20250109 21:10:28.587179 22190 raft_consensus.cc:357] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:28.588049 22190 raft_consensus.cc:738] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:28.588626 22190 consensus_queue.cc:260] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:28.589138 22193 raft_consensus.cc:357] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:28.590301 22193 raft_consensus.cc:738] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:28.590947 22193 consensus_queue.cc:260] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:28.593722 22190 ts_tablet_manager.cc:1428] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20250109 21:10:28.594254 22193 ts_tablet_manager.cc:1428] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.009s user 0.006s sys 0.000s
I20250109 21:10:28.595431 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-4271f4a728084e65b74f13aa9fa0c6c0 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:28.595824 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-4271f4a728084e65b74f13aa9fa0c6c0 on tablet 4271f4a728084e65b74f13aa9fa0c6c0 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:28.597026 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-7a4ca66c3087428aaf05f37bc1ba32ee received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:28.597420 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-7a4ca66c3087428aaf05f37bc1ba32ee on tablet 7a4ca66c3087428aaf05f37bc1ba32ee with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:28.895272 21881 raft_consensus.cc:1212] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:28.926353 21881 raft_consensus.cc:1212] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:28.941298 21881 raft_consensus.cc:1212] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:29.081429 21881 raft_consensus.cc:1212] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:29.338485 22058 raft_consensus.cc:1059] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:29.340329 22058 consensus_queue.cc:237] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:29.347584 21881 raft_consensus.cc:1270] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.347582 21320 raft_consensus.cc:1270] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.349224 22163 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.350059 22058 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.350613 21243 raft_consensus.cc:1270] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.351661 22199 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.362744 22199 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.364078 21316 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.376929 21066 catalog_manager.cc:5526] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:29.378425 21881 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.387429 21243 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.435473 21171 consensus_queue.cc:237] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:29.438815 21881 raft_consensus.cc:1270] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:29.440346 22163 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:29.441720 21243 raft_consensus.cc:1270] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:29.443177 22163 consensus_queue.cc:1035] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:29.447332 22163 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.449252 21881 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.455083 22200 raft_consensus.cc:1059] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:29.454839 21243 raft_consensus.cc:2949] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.457391 22200 consensus_queue.cc:237] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:29.458709 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet f8d059ec48cb46dfac04405794b984ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:29.462864 21068 catalog_manager.cc:5526] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:29.477557 21316 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.479131 22163 raft_consensus.cc:1059] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:29.479167 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet f8d059ec48cb46dfac04405794b984ee with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:29.479568 21164 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.481209 22046 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.481057 22163 consensus_queue.cc:237] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:29.482610 22046 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.006s
I20250109 21:10:29.499931 22211 tablet_replica.cc:331] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:29.500850 22211 raft_consensus.cc:2238] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:29.501423 22211 raft_consensus.cc:2267] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:29.504510 22211 ts_tablet_manager.cc:1905] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:29.506099 21880 raft_consensus.cc:1270] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.506515 21242 raft_consensus.cc:1270] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.507493 21316 raft_consensus.cc:1270] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.507804 22199 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.509176 22058 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.509888 21881 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.511029 22058 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.511937 22200 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.513370 22166 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.517971 21171 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.533262 22211 ts_tablet_manager.cc:1918] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:29.533739 22211 log.cc:1198] T f8d059ec48cb46dfac04405794b984ee P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/f8d059ec48cb46dfac04405794b984ee
I20250109 21:10:29.536021 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet f8d059ec48cb46dfac04405794b984ee (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:29.552971 21069 catalog_manager.cc:5526] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.555168 21320 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.554095 21880 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.566159 22215 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.577267 21320 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.579706 21243 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.579783 21881 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.596153 21069 catalog_manager.cc:5526] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:29.612031 21164 consensus_queue.cc:237] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:29.617271 21881 raft_consensus.cc:1270] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:29.618845 21242 raft_consensus.cc:1270] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:29.618882 22163 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:29.621770 22163 consensus_queue.cc:1035] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:29.628631 22163 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.629710 21881 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.633019 21242 raft_consensus.cc:2949] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.637048 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 4271f4a728084e65b74f13aa9fa0c6c0 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:29.640473 21065 catalog_manager.cc:5526] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.650439 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 4271f4a728084e65b74f13aa9fa0c6c0 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:29.651299 22211 tablet_replica.cc:331] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:29.652278 22211 raft_consensus.cc:2238] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:29.652830 22211 raft_consensus.cc:2267] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:29.655462 22211 ts_tablet_manager.cc:1905] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:29.666823 22211 ts_tablet_manager.cc:1918] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:29.667251 22211 log.cc:1198] T 4271f4a728084e65b74f13aa9fa0c6c0 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/4271f4a728084e65b74f13aa9fa0c6c0
I20250109 21:10:29.668537 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 4271f4a728084e65b74f13aa9fa0c6c0 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:29.695247 22167 raft_consensus.cc:1059] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:29.697000 22167 consensus_queue.cc:237] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:29.704947 21242 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.718727 22150 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.719046 21881 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.719244 21164 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:29.720706 22150 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:29.722076 22223 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:29.736542 22222 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.738315 21171 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.748193 21243 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.758831 21069 catalog_manager.cc:5526] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:29.759486 21881 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.795262 21320 consensus_queue.cc:237] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:29.804221 21243 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:29.805370 21881 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:29.805461 22222 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:29.806571 22223 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:29.812515 22150 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.820082 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 7a4ca66c3087428aaf05f37bc1ba32ee with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:29.822743 21242 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.830960 21881 raft_consensus.cc:2949] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.840325 21066 catalog_manager.cc:5526] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:29.853253 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet 7a4ca66c3087428aaf05f37bc1ba32ee with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:29.858053 22227 tablet_replica.cc:331] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:29.859074 22227 raft_consensus.cc:2238] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:29.859742 22227 raft_consensus.cc:2267] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:29.863996 22227 ts_tablet_manager.cc:1905] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:29.878064 22227 ts_tablet_manager.cc:1918] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:29.878387 22227 log.cc:1198] T 7a4ca66c3087428aaf05f37bc1ba32ee P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/7a4ca66c3087428aaf05f37bc1ba32ee
I20250109 21:10:29.879777 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet 7a4ca66c3087428aaf05f37bc1ba32ee (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:30.053874 21242 consensus_queue.cc:237] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:30.057992 21880 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:30.059362 21320 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:30.059974 22200 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:30.060776 22166 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:30.066229 22046 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:30.068161 21880 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:30.071830 21320 raft_consensus.cc:2949] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:30.075507 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet c714104a3f784fa2a8dbab3a26b67e16 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:30.083115 21069 catalog_manager.cc:5526] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:30.090780 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet c714104a3f784fa2a8dbab3a26b67e16 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:30.091588 22227 tablet_replica.cc:331] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:30.092473 22227 raft_consensus.cc:2238] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:30.092955 22227 raft_consensus.cc:2267] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:30.095037 22227 ts_tablet_manager.cc:1905] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:30.104666 22227 ts_tablet_manager.cc:1918] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:30.105031 22227 log.cc:1198] T c714104a3f784fa2a8dbab3a26b67e16 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/c714104a3f784fa2a8dbab3a26b67e16
I20250109 21:10:30.106420 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet c714104a3f784fa2a8dbab3a26b67e16 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:31.136595 21164 consensus_queue.cc:237] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.141721 21316 raft_consensus.cc:1270] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:31.141798 21136 consensus_peers.cc:487] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 800dbae8cc64427c8e80cc1ac7b42769. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:31.142416 21243 raft_consensus.cc:1270] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:31.142813 22220 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:31.143690 22163 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:31.150377 22163 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.151181 21316 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.151693 21243 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.164487 21065 catalog_manager.cc:5526] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.174296 21316 consensus_queue.cc:237] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.185938 21243 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:31.186503 21288 consensus_peers.cc:487] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 909c8965e81d4f84a75ef2fd61bcbe72. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:31.187832 21164 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:31.187644 22150 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:31.191538 22222 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:31.197518 22150 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.199769 21242 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.208748 21164 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.218786 21165 consensus_queue.cc:237] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.223174 21066 catalog_manager.cc:5526] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
W20250109 21:10:31.249184 21136 consensus_peers.cc:487] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 703480173d7142d0b22a2ec903e1707d. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:31.251637 21320 raft_consensus.cc:1270] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:31.251835 21242 raft_consensus.cc:1270] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:31.252698 22220 consensus_queue.cc:1035] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:31.253461 22163 consensus_queue.cc:1035] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:31.262269 22220 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.273937 21242 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.283598 21243 consensus_queue.cc:237] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.287843 21316 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.292117 21065 catalog_manager.cc:5526] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:31.295809 21320 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:31.296953 22166 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:31.297283 21165 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:31.297719 21213 consensus_peers.cc:487] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 0c81c3f41770456c82eac4f8e6aa7552. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:31.299217 22228 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:31.319101 22166 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.320900 21320 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.322127 21165 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.335362 21069 catalog_manager.cc:5526] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:31.702329 22251 ts_tablet_manager.cc:927] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:31.703627 22252 ts_tablet_manager.cc:927] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:31.706625 22251 tablet_copy_client.cc:323] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:31.708153 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 800dbae8cc64427c8e80cc1ac7b42769 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:31.708307 22252 tablet_copy_client.cc:323] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:31.708703 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 800dbae8cc64427c8e80cc1ac7b42769 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-800dbae8cc64427c8e80cc1ac7b42769
I20250109 21:10:31.709810 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 909c8965e81d4f84a75ef2fd61bcbe72 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:31.710359 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 909c8965e81d4f84a75ef2fd61bcbe72 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-909c8965e81d4f84a75ef2fd61bcbe72
I20250109 21:10:31.716322 21181 tablet_copy_source_session.cc:215] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:31.717598 21334 tablet_copy_source_session.cc:215] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:31.719143 22251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 800dbae8cc64427c8e80cc1ac7b42769. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:31.722296 22252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 909c8965e81d4f84a75ef2fd61bcbe72. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:31.722648 22255 ts_tablet_manager.cc:927] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:31.735224 22252 tablet_copy_client.cc:806] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:31.735793 22252 tablet_copy_client.cc:670] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:31.737788 22251 tablet_copy_client.cc:806] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:31.738351 22251 tablet_copy_client.cc:670] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:31.740483 22255 tablet_copy_client.cc:323] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:31.742355 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet 0c81c3f41770456c82eac4f8e6aa7552 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:31.742808 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet 0c81c3f41770456c82eac4f8e6aa7552 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-0c81c3f41770456c82eac4f8e6aa7552
I20250109 21:10:31.744530 22252 tablet_copy_client.cc:538] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:31.747896 22251 tablet_copy_client.cc:538] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:31.750067 21258 tablet_copy_source_session.cc:215] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:31.752513 22252 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:31.753118 22255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c81c3f41770456c82eac4f8e6aa7552. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:31.753187 22257 ts_tablet_manager.cc:927] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:31.756229 22251 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:31.771730 22255 tablet_copy_client.cc:806] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:31.772493 22255 tablet_copy_client.cc:670] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:31.778259 22255 tablet_copy_client.cc:538] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:31.787757 22257 tablet_copy_client.cc:323] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:31.790012 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 703480173d7142d0b22a2ec903e1707d from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:31.790642 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 703480173d7142d0b22a2ec903e1707d from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-703480173d7142d0b22a2ec903e1707d
I20250109 21:10:31.801939 22255 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:31.811179 21181 tablet_copy_source_session.cc:215] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:31.818851 22251 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:31.819862 22251 tablet_bootstrap.cc:492] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:31.820626 22251 ts_tablet_manager.cc:1397] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.065s user 0.025s sys 0.010s
I20250109 21:10:31.824705 22257 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 703480173d7142d0b22a2ec903e1707d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:31.826429 22251 raft_consensus.cc:357] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.829259 22251 raft_consensus.cc:738] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:31.830189 22251 consensus_queue.cc:260] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.841157 22255 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:31.847154 22251 ts_tablet_manager.cc:1428] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.025s user 0.004s sys 0.007s
I20250109 21:10:31.847815 22257 tablet_copy_client.cc:806] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:31.848302 22257 tablet_copy_client.cc:670] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:31.848826 22255 tablet_bootstrap.cc:492] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:31.849527 22255 ts_tablet_manager.cc:1397] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.048s user 0.020s sys 0.012s
I20250109 21:10:31.852802 22252 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:31.854466 22252 tablet_bootstrap.cc:492] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:31.855150 22252 ts_tablet_manager.cc:1397] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.103s user 0.017s sys 0.005s
I20250109 21:10:31.856773 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-800dbae8cc64427c8e80cc1ac7b42769 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:31.857157 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-800dbae8cc64427c8e80cc1ac7b42769 on tablet 800dbae8cc64427c8e80cc1ac7b42769 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:31.857589 22252 raft_consensus.cc:357] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.858384 22252 raft_consensus.cc:738] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:31.852881 22257 tablet_copy_client.cc:538] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:31.852818 22255 raft_consensus.cc:357] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.859272 22255 raft_consensus.cc:738] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:31.859943 22255 consensus_queue.cc:260] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.862708 22255 ts_tablet_manager.cc:1428] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20250109 21:10:31.859045 22252 consensus_queue.cc:260] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.864161 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-0c81c3f41770456c82eac4f8e6aa7552 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:31.864576 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-0c81c3f41770456c82eac4f8e6aa7552 on tablet 0c81c3f41770456c82eac4f8e6aa7552 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:31.866235 22252 ts_tablet_manager.cc:1428] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20250109 21:10:31.867928 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-909c8965e81d4f84a75ef2fd61bcbe72 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:31.868333 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-909c8965e81d4f84a75ef2fd61bcbe72 on tablet 909c8965e81d4f84a75ef2fd61bcbe72 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:31.868484 22257 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:31.886344 22257 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:31.887122 22257 tablet_bootstrap.cc:492] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:31.887732 22257 ts_tablet_manager.cc:1397] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.003s
I20250109 21:10:31.891662 22257 raft_consensus.cc:357] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.892727 22257 raft_consensus.cc:738] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:31.893321 22257 consensus_queue.cc:260] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:31.895757 22257 ts_tablet_manager.cc:1428] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:31.897310 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-703480173d7142d0b22a2ec903e1707d received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:31.897624 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-703480173d7142d0b22a2ec903e1707d on tablet 703480173d7142d0b22a2ec903e1707d with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:32.089797 21880 raft_consensus.cc:1212] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:32.121014 21880 raft_consensus.cc:1212] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:32.153522 21880 raft_consensus.cc:1212] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:32.207181 21880 raft_consensus.cc:1212] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:32.500514 22228 raft_consensus.cc:1059] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:32.502599 22228 consensus_queue.cc:237] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:32.509470 21320 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.511116 21880 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.511106 22166 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:32.513149 21171 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.512557 22266 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.514585 22228 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.542208 22166 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.543824 21171 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.547051 21881 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.560914 21065 catalog_manager.cc:5526] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.565685 21320 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.606554 21248 consensus_queue.cc:237] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:32.611419 21881 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:32.612588 22166 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:32.612818 21320 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:32.617807 22166 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:32.619750 22228 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.623569 21316 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.629240 21881 raft_consensus.cc:2949] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.630483 22232 raft_consensus.cc:1059] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:32.632858 22232 consensus_queue.cc:237] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:32.649277 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 0c81c3f41770456c82eac4f8e6aa7552 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:32.651258 21066 catalog_manager.cc:5526] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.658917 21881 raft_consensus.cc:1270] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.661305 21248 raft_consensus.cc:1270] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.662773 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet 0c81c3f41770456c82eac4f8e6aa7552 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:32.663412 21316 raft_consensus.cc:1270] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.663462 22232 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20250109 21:10:32.668673 22260 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.671697 22163 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.713707 22276 tablet_replica.cc:331] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:32.714506 22276 raft_consensus.cc:2238] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:32.715188 22276 raft_consensus.cc:2267] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:32.715853 22242 raft_consensus.cc:1059] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:32.717831 22163 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.719897 22242 consensus_queue.cc:237] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:32.720283 21881 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.730208 21321 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.728761 21248 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.735291 22277 raft_consensus.cc:1059] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:32.737723 22277 consensus_queue.cc:237] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:32.745304 21880 raft_consensus.cc:1270] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.745859 21320 raft_consensus.cc:1270] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.747095 22277 consensus_queue.cc:1035] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:32.746667 21068 catalog_manager.cc:5526] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.749727 21242 raft_consensus.cc:1270] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.749920 22163 consensus_queue.cc:1035] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.751112 22232 consensus_queue.cc:1035] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.751329 22276 ts_tablet_manager.cc:1905] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:32.767391 21171 consensus_queue.cc:237] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:32.779884 21319 raft_consensus.cc:1270] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:32.779861 22276 ts_tablet_manager.cc:1918] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:32.780671 22276 log.cc:1198] T 0c81c3f41770456c82eac4f8e6aa7552 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/0c81c3f41770456c82eac4f8e6aa7552
I20250109 21:10:32.782131 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet 0c81c3f41770456c82eac4f8e6aa7552 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:32.782357 22163 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:32.784006 21881 raft_consensus.cc:1270] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:32.786846 22163 consensus_queue.cc:1035] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:32.793684 22232 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.796314 21881 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.805823 21321 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.808655 21319 raft_consensus.cc:2949] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.801916 22277 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.815910 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 800dbae8cc64427c8e80cc1ac7b42769 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:32.824040 21248 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.828138 21880 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.828891 21066 catalog_manager.cc:5526] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:32.838150 21878 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.839075 21164 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.844208 21243 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:32.856278 22243 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.858099 22243 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.858938 22265 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:32.861445 21069 catalog_manager.cc:5526] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.876655 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet 800dbae8cc64427c8e80cc1ac7b42769 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:32.899431 22290 tablet_replica.cc:331] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:32.906100 22285 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.908768 21878 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.913736 21243 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.920205 21171 consensus_queue.cc:237] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:32.927963 22290 raft_consensus.cc:2238] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:32.929013 22290 raft_consensus.cc:2267] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:32.931854 21878 raft_consensus.cc:1270] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:32.934896 22290 ts_tablet_manager.cc:1905] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:32.935014 22287 consensus_queue.cc:1035] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:32.941823 21069 catalog_manager.cc:5526] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.938570 21242 raft_consensus.cc:1270] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:32.952661 21171 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.961083 22163 consensus_queue.cc:1035] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:32.964435 21878 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.964447 22277 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.980571 22290 ts_tablet_manager.cc:1918] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:32.979902 21068 catalog_manager.cc:5526] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:32.981195 22290 log.cc:1198] T 800dbae8cc64427c8e80cc1ac7b42769 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/800dbae8cc64427c8e80cc1ac7b42769
I20250109 21:10:32.989107 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet 800dbae8cc64427c8e80cc1ac7b42769 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:32.989785 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 703480173d7142d0b22a2ec903e1707d with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:32.989913 21321 consensus_queue.cc:237] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:32.993191 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 703480173d7142d0b22a2ec903e1707d with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:32.995975 21242 raft_consensus.cc:2949] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:33.005095 21878 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:33.006639 22293 tablet_replica.cc:331] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:33.007628 22293 raft_consensus.cc:2238] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:33.008229 22293 raft_consensus.cc:2267] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:33.008486 21171 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:33.009766 22243 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:33.014235 22242 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:33.011952 22293 ts_tablet_manager.cc:1905] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:33.024771 22288 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:33.028923 21168 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:33.028831 21878 raft_consensus.cc:2949] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:33.036443 22293 ts_tablet_manager.cc:1918] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:33.036906 22293 log.cc:1198] T 703480173d7142d0b22a2ec903e1707d P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/703480173d7142d0b22a2ec903e1707d
I20250109 21:10:33.038555 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 703480173d7142d0b22a2ec903e1707d (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:33.039527 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 909c8965e81d4f84a75ef2fd61bcbe72 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:33.044714 21068 catalog_manager.cc:5526] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:33.054282 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet 909c8965e81d4f84a75ef2fd61bcbe72 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:33.055229 22290 tablet_replica.cc:331] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:33.056171 22290 raft_consensus.cc:2238] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:33.056805 22290 raft_consensus.cc:2267] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:33.059347 22290 ts_tablet_manager.cc:1905] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:33.071101 22290 ts_tablet_manager.cc:1918] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:33.071522 22290 log.cc:1198] T 909c8965e81d4f84a75ef2fd61bcbe72 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/909c8965e81d4f84a75ef2fd61bcbe72
I20250109 21:10:33.072693 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet 909c8965e81d4f84a75ef2fd61bcbe72 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:34.149860 21168 consensus_queue.cc:237] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
W20250109 21:10:34.157436 21136 consensus_peers.cc:487] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 6f7c70db395b4c95bdd3a519fbff09f1. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:34.157934 21321 raft_consensus.cc:1270] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:34.159374 21242 raft_consensus.cc:1270] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:34.159466 22297 consensus_queue.cc:1035] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:34.160526 22277 consensus_queue.cc:1035] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:34.167702 22297 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.169011 21321 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.169543 21242 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.186412 21066 catalog_manager.cc:5526] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.195459 21321 consensus_queue.cc:237] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:34.203387 21242 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:34.204706 22288 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:34.205145 21168 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:34.205864 21288 consensus_peers.cc:487] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f75eb10b9fad472794f2398d9f305706. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:34.206856 22243 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:34.212972 22288 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.214506 21242 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
W20250109 21:10:34.268743 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:33191, user_credentials={real_user=slave}} blocked reactor thread for 47998.2us
I20250109 21:10:34.272462 21171 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.270725 21069 catalog_manager.cc:5526] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.285957 21242 consensus_queue.cc:237] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
W20250109 21:10:34.310092 21213 consensus_peers.cc:487] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 33a9dea3cbbb40abbdf4eb26e597f857. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:34.311334 21171 raft_consensus.cc:1270] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:34.312719 22295 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:34.313781 21320 raft_consensus.cc:1270] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:34.316337 22295 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:34.325592 22166 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.327049 21164 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.327754 21320 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.341794 21316 consensus_queue.cc:237] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:34.353192 21242 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:34.350267 21066 catalog_manager.cc:5526] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
W20250109 21:10:34.353907 21288 consensus_peers.cc:487] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: ec98ab18b5ba44949aeef1a8a519bb67. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:34.354450 21164 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:34.354866 22243 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:34.356146 22308 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:34.367270 22307 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.368667 21243 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.369441 21164 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:34.385003 21069 catalog_manager.cc:5526] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:34.447914 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:34.502619 21242 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "07149574483a42e6849046b112072921"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:34.503413 21242 raft_consensus.cc:604] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:34.516692 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "16dee0cc12b842ec877d167505529061"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:34.517127 21320 raft_consensus.cc:604] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:34.519608 21316 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:34.520103 21316 raft_consensus.cc:604] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:34.539667 21164 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:34.540284 21164 raft_consensus.cc:604] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:34.543501 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:34.543923 21320 raft_consensus.cc:604] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:34.546558 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:34.547096 21320 raft_consensus.cc:604] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:34.552434 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f660a562716e4048a180570218fae1d4"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:34.552924 21320 raft_consensus.cc:604] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:34.555104 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 7
I20250109 21:10:34.556406 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:34.556901 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:34.572540 22288 raft_consensus.cc:988] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:34.572983 22243 raft_consensus.cc:1076] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:34.574251 21243 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "16dee0cc12b842ec877d167505529061"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:34.575193 21243 raft_consensus.cc:491] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:34.575636 21243 raft_consensus.cc:3054] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.584308 21243 raft_consensus.cc:513] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:34.587304 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16dee0cc12b842ec877d167505529061" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:34.588033 21164 raft_consensus.cc:3054] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.590795 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "16dee0cc12b842ec877d167505529061" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:34.591406 21319 raft_consensus.cc:3049] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:34.591653 21319 raft_consensus.cc:738] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:34.592357 21319 consensus_queue.cc:260] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:34.593417 21319 raft_consensus.cc:3054] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.597296 21164 raft_consensus.cc:2463] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:34.589596 21243 leader_election.cc:290] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:34.599907 21213 leader_election.cc:304] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:34.600518 21319 raft_consensus.cc:2463] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:34.600766 22248 raft_consensus.cc:2798] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:34.602233 22248 raft_consensus.cc:695] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:34.603165 22248 consensus_queue.cc:237] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:34.622803 21068 catalog_manager.cc:5526] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:34.647804 22322 ts_tablet_manager.cc:927] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:34.649559 22322 tablet_copy_client.cc:323] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:34.651242 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 6f7c70db395b4c95bdd3a519fbff09f1 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:34.651777 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 6f7c70db395b4c95bdd3a519fbff09f1 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-6f7c70db395b4c95bdd3a519fbff09f1
I20250109 21:10:34.658350 21181 tablet_copy_source_session.cc:215] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:34.661338 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6f7c70db395b4c95bdd3a519fbff09f1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:34.676554 22322 tablet_copy_client.cc:806] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:34.677202 22322 tablet_copy_client.cc:670] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:34.681303 22322 tablet_copy_client.cc:538] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:34.690709 22322 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:34.711500 22322 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:34.712260 22322 tablet_bootstrap.cc:492] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:34.712829 22322 ts_tablet_manager.cc:1397] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.022s user 0.017s sys 0.005s
I20250109 21:10:34.715484 22322 raft_consensus.cc:357] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:34.716332 22322 raft_consensus.cc:738] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:34.716970 22322 consensus_queue.cc:260] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:34.722697 22322 ts_tablet_manager.cc:1428] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.010s user 0.006s sys 0.003s
I20250109 21:10:34.726843 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-6f7c70db395b4c95bdd3a519fbff09f1 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:34.727423 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-6f7c70db395b4c95bdd3a519fbff09f1 on tablet 6f7c70db395b4c95bdd3a519fbff09f1 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:34.761875 22322 ts_tablet_manager.cc:927] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:34.764319 22322 tablet_copy_client.cc:323] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:34.766069 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet ec98ab18b5ba44949aeef1a8a519bb67 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:34.766491 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet ec98ab18b5ba44949aeef1a8a519bb67 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-ec98ab18b5ba44949aeef1a8a519bb67
I20250109 21:10:34.773690 21334 tablet_copy_source_session.cc:215] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:34.776576 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec98ab18b5ba44949aeef1a8a519bb67. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:34.788854 22322 tablet_copy_client.cc:806] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:34.789363 22322 tablet_copy_client.cc:670] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:34.792586 22322 tablet_copy_client.cc:538] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:34.799795 22322 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:34.816201 22329 ts_tablet_manager.cc:927] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:34.819293 22322 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:34.820219 22322 tablet_bootstrap.cc:492] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:34.821127 22322 ts_tablet_manager.cc:1397] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.022s user 0.020s sys 0.000s
I20250109 21:10:34.872521 22329 tablet_copy_client.cc:323] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:34.875016 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet f75eb10b9fad472794f2398d9f305706 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:34.875528 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet f75eb10b9fad472794f2398d9f305706 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-f75eb10b9fad472794f2398d9f305706
I20250109 21:10:34.875517 22322 raft_consensus.cc:357] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:34.889900 22322 raft_consensus.cc:738] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:34.891201 22322 consensus_queue.cc:260] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:34.894979 22322 ts_tablet_manager.cc:1428] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.074s user 0.009s sys 0.007s
I20250109 21:10:34.898444 21333 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-ec98ab18b5ba44949aeef1a8a519bb67 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:34.898896 21333 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-ec98ab18b5ba44949aeef1a8a519bb67 on tablet ec98ab18b5ba44949aeef1a8a519bb67 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:34.904242 22243 raft_consensus.cc:988] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:34.904644 22243 raft_consensus.cc:1076] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:34.906193 21880 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f660a562716e4048a180570218fae1d4"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58774
I20250109 21:10:34.906698 21880 raft_consensus.cc:491] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:34.907045 21880 raft_consensus.cc:3054] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.916996 22322 ts_tablet_manager.cc:927] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:34.921361 22243 raft_consensus.cc:988] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:34.918138 21880 raft_consensus.cc:513] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:34.921834 22307 raft_consensus.cc:1076] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:34.924943 21243 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:34.925310 21334 tablet_copy_source_session.cc:215] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:34.925448 21243 raft_consensus.cc:491] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:34.925856 21243 raft_consensus.cc:3054] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.928180 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f660a562716e4048a180570218fae1d4" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:34.928828 21171 raft_consensus.cc:3054] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.929986 21880 leader_election.cc:290] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:34.931448 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f660a562716e4048a180570218fae1d4" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:34.932031 21320 raft_consensus.cc:3049] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:34.932358 21320 raft_consensus.cc:738] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:34.933112 21320 consensus_queue.cc:260] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:34.934309 21320 raft_consensus.cc:3054] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.934047 21243 raft_consensus.cc:513] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:34.936748 21243 leader_election.cc:290] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:34.937726 22329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f75eb10b9fad472794f2398d9f305706. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:34.939352 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:34.940057 21319 raft_consensus.cc:3049] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:34.940423 21319 raft_consensus.cc:738] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:34.941056 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "79be174d43c746b8bb3e3f401cef0c4f" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:34.941639 21164 raft_consensus.cc:3054] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.941354 21319 consensus_queue.cc:260] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:34.942569 21319 raft_consensus.cc:3054] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:34.948035 21164 raft_consensus.cc:2463] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:34.955852 21319 raft_consensus.cc:2463] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:34.957093 21213 leader_election.cc:304] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:34.957569 22329 tablet_copy_client.cc:806] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:34.957857 22248 raft_consensus.cc:2798] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:34.958128 22329 tablet_copy_client.cc:670] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:34.960217 21171 raft_consensus.cc:2463] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:34.961187 21843 leader_election.cc:304] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:34.962034 22325 raft_consensus.cc:2798] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:34.958542 22248 raft_consensus.cc:695] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:34.964963 22248 consensus_queue.cc:237] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:34.972681 22329 tablet_copy_client.cc:538] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:34.979003 22326 raft_consensus.cc:988] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:34.979601 22297 raft_consensus.cc:1076] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:34.981801 21320 raft_consensus.cc:2463] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:34.983206 22288 raft_consensus.cc:988] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:34.983731 22243 raft_consensus.cc:1076] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:34.986899 22288 raft_consensus.cc:988] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:34.987511 22243 raft_consensus.cc:1076] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:34.991477 22322 tablet_copy_client.cc:323] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:34.993145 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet 33a9dea3cbbb40abbdf4eb26e597f857 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:34.993647 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet 33a9dea3cbbb40abbdf4eb26e597f857 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-33a9dea3cbbb40abbdf4eb26e597f857
I20250109 21:10:34.993577 21068 catalog_manager.cc:5526] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:34.996387 22329 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:35.001395 21258 tablet_copy_source_session.cc:215] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:35.004546 21164 raft_consensus.cc:1270] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:34.990757 21320 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:35.008193 21320 raft_consensus.cc:491] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:35.008638 21320 raft_consensus.cc:3054] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.010277 21243 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:35.010795 21243 raft_consensus.cc:491] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:35.011085 22166 raft_consensus.cc:988] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:35.011153 21243 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.015141 21320 raft_consensus.cc:513] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:35.015810 22325 raft_consensus.cc:695] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:35.016050 22166 raft_consensus.cc:1076] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:35.015602 22335 consensus_queue.cc:1035] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:35.016863 22325 consensus_queue.cc:237] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:35.018362 21243 raft_consensus.cc:513] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:35.019975 21878 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "07149574483a42e6849046b112072921"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58796
I20250109 21:10:35.020509 21878 raft_consensus.cc:491] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:35.020824 21878 raft_consensus.cc:3054] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.020989 22322 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 33a9dea3cbbb40abbdf4eb26e597f857. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:35.021533 21243 leader_election.cc:290] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:35.023588 21248 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:35.023643 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:35.024128 21248 raft_consensus.cc:491] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:35.024259 21319 raft_consensus.cc:3049] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:35.024487 21248 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.024621 21319 raft_consensus.cc:738] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:35.025409 21319 consensus_queue.cc:260] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:35.026247 21319 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.027334 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:35.027879 21165 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.032135 21319 raft_consensus.cc:2463] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:35.036202 22329 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:35.036106 21878 raft_consensus.cc:513] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:35.036789 22322 tablet_copy_client.cc:806] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:35.037021 22329 tablet_bootstrap.cc:492] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:35.037431 22322 tablet_copy_client.cc:670] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:35.037528 21214 leader_election.cc:304] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:35.038689 22338 raft_consensus.cc:2798] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:35.039068 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:35.039698 21242 raft_consensus.cc:3049] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:35.039996 21242 raft_consensus.cc:738] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:35.040710 21242 consensus_queue.cc:260] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:35.041525 22338 raft_consensus.cc:695] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:35.042359 21242 raft_consensus.cc:3054] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.042413 22338 consensus_queue.cc:237] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:35.037707 22329 ts_tablet_manager.cc:1397] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.041s user 0.013s sys 0.008s
I20250109 21:10:35.047895 22329 raft_consensus.cc:357] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.048818 22329 raft_consensus.cc:738] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:35.049526 22329 consensus_queue.cc:260] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.052103 21248 raft_consensus.cc:513] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.050312 21242 raft_consensus.cc:2463] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:35.073771 21843 leader_election.cc:304] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:35.076738 22322 tablet_copy_client.cc:538] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:35.078365 21248 leader_election.cc:290] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:35.079218 21316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:35.079766 21316 raft_consensus.cc:3049] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:35.080050 21316 raft_consensus.cc:738] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:35.080762 21316 consensus_queue.cc:260] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.083209 21316 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.083876 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:35.084506 21166 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.086406 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:35.087000 21168 raft_consensus.cc:3049] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:35.087378 21168 raft_consensus.cc:738] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:35.088073 21168 consensus_queue.cc:260] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:35.089046 21168 raft_consensus.cc:3054] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.091235 21166 raft_consensus.cc:2463] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:35.050424 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "07149574483a42e6849046b112072921" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:35.096556 21319 raft_consensus.cc:3054] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.051070 21878 leader_election.cc:290] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:35.047868 21320 leader_election.cc:290] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:35.053974 22329 ts_tablet_manager.cc:1428] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250109 21:10:35.061354 21068 catalog_manager.cc:5526] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:35.050230 21165 raft_consensus.cc:2463] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:35.071168 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b4695aea7c274b7e830e07c2fdbb1dc6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:35.101471 21243 raft_consensus.cc:3054] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.107144 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-f75eb10b9fad472794f2398d9f305706 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:35.107546 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-f75eb10b9fad472794f2398d9f305706 on tablet f75eb10b9fad472794f2398d9f305706 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:35.108527 21164 raft_consensus.cc:1235] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Rejecting Update request from peer 0175ef2fbd0349568ba2bf83788476ea for earlier term 1. Current term is 2. Ops: []
I20250109 21:10:35.110217 21213 leader_election.cc:304] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:35.109967 21066 catalog_manager.cc:5526] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:35.117429 21243 raft_consensus.cc:2463] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:35.119243 22322 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:35.120754 21319 raft_consensus.cc:2463] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:35.110648 21316 raft_consensus.cc:2463] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:35.111907 22335 raft_consensus.cc:2798] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:35.122897 22335 raft_consensus.cc:695] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:35.122974 22325 raft_consensus.cc:2798] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:35.123545 22325 raft_consensus.cc:695] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:35.123896 22335 consensus_queue.cc:237] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.124325 22325 consensus_queue.cc:237] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:35.126677 21288 leader_election.cc:304] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:35.128618 22243 raft_consensus.cc:2798] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:35.131662 21168 raft_consensus.cc:2463] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:35.169510 22243 raft_consensus.cc:695] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:35.170600 22243 consensus_queue.cc:237] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:35.176571 21321 raft_consensus.cc:1270] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:35.180166 22336 consensus_queue.cc:1035] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:35.183560 21066 catalog_manager.cc:5526] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:35.217243 21878 raft_consensus.cc:1212] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:35.223825 21066 catalog_manager.cc:5526] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:35.234970 22322 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:35.235867 22322 tablet_bootstrap.cc:492] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:35.236620 22322 ts_tablet_manager.cc:1397] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.118s user 0.015s sys 0.015s
I20250109 21:10:35.239208 22322 raft_consensus.cc:357] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.240099 22322 raft_consensus.cc:738] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:35.240773 22322 consensus_queue.cc:260] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.242607 21248 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:35.243278 21248 raft_consensus.cc:604] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Received request to transfer leadership
I20250109 21:10:35.247607 21878 raft_consensus.cc:1212] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:35.249979 22322 ts_tablet_manager.cc:1428] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.013s user 0.005s sys 0.000s
I20250109 21:10:35.252035 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-33a9dea3cbbb40abbdf4eb26e597f857 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:35.252442 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-33a9dea3cbbb40abbdf4eb26e597f857 on tablet 33a9dea3cbbb40abbdf4eb26e597f857 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:35.264087 21066 catalog_manager.cc:5526] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:35.271528 21248 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:35.271979 21248 raft_consensus.cc:604] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Received request to transfer leadership
W20250109 21:10:35.272814 21055 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: leadership transfer for ec98ab18b5ba44949aeef1a8a519bb67 already in progress [suppressed 2 similar messages]
I20250109 21:10:35.275125 21248 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:35.275512 21248 raft_consensus.cc:604] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Received request to transfer leadership
W20250109 21:10:35.276512 21117 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: leadership transfer for ec98ab18b5ba44949aeef1a8a519bb67 already in progress
W20250109 21:10:35.276854 21117 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: leadership transfer for ec98ab18b5ba44949aeef1a8a519bb67 already in progress
I20250109 21:10:35.451774 21878 raft_consensus.cc:1212] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:35.463315 21165 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:35.464272 22335 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:35.474179 21321 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:35.475644 22166 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:35.516470 21316 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:35.520049 21165 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:35.523252 22248 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:35.527073 22325 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:35.532357 21321 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:35.533722 22325 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:35.557197 21168 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:35.561964 21322 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:35.562659 22166 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:35.570809 22335 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:35.579196 21316 raft_consensus.cc:1270] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:35.587330 22325 consensus_queue.cc:1035] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:10:35.603518 21242 raft_consensus.cc:1270] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:35.605439 22243 consensus_queue.cc:1035] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:35.618593 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:35.631523 22335 raft_consensus.cc:988] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:35.631980 22335 raft_consensus.cc:1076] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:35.635807 21319 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58542
I20250109 21:10:35.636210 21165 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:35.637853 22335 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:35.675036 21319 raft_consensus.cc:491] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:35.679904 21319 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:35.692641 21168 raft_consensus.cc:1270] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:35.694063 22307 consensus_queue.cc:1035] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:35.703449 21319 raft_consensus.cc:513] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.719210 22342 raft_consensus.cc:1059] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:35.721668 22342 consensus_queue.cc:237] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
W20250109 21:10:35.739073 21843 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 143842us
I20250109 21:10:35.749351 21242 raft_consensus.cc:1270] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:35.749593 21878 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:35.750550 21880 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Advancing to term 2
I20250109 21:10:35.751907 22307 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:35.752715 21164 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:35.757616 21242 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:35.757745 21880 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:35.759382 21319 leader_election.cc:290] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 3 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:35.760907 22288 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:35.761706 22243 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:35.768079 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:35.768774 21248 raft_consensus.cc:3049] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:35.768848 22166 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:35.769192 21248 raft_consensus.cc:738] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:35.777827 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:35.782042 21164 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:35.770836 21248 consensus_queue.cc:260] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.791844 21248 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:35.814164 22325 consensus_queue.cc:1035] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:10:35.816243 22297 raft_consensus.cc:1059] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:35.823217 22297 consensus_queue.cc:237] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:35.836855 22243 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:35.853940 21248 raft_consensus.cc:2463] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 3.
I20250109 21:10:35.854789 21242 raft_consensus.cc:1270] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:35.860036 21880 raft_consensus.cc:1270] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:35.865221 22277 consensus_queue.cc:1035] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:35.871528 21166 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:35.873145 21288 leader_election.cc:304] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:35.874699 22307 raft_consensus.cc:2798] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:35.875296 22307 raft_consensus.cc:695] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:35.876173 22307 consensus_queue.cc:237] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:35.884351 21881 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:35.894726 21241 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:35.896217 21320 raft_consensus.cc:1270] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:35.897861 22277 consensus_queue.cc:1035] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:35.905408 22277 consensus_queue.cc:1035] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:35.909512 21164 raft_consensus.cc:2463] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 3.
I20250109 21:10:35.915652 21068 catalog_manager.cc:5526] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:35.918160 21242 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:35.919421 21242 raft_consensus.cc:604] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:35.923651 21319 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:35.924425 21319 raft_consensus.cc:604] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:35.929844 21164 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "61283e0a72e04a589880431a717f04f3"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:35.930430 21164 raft_consensus.cc:604] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:35.939882 22260 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:35.946684 21319 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7a4ca66c3087428aaf05f37bc1ba32ee"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:35.947268 21319 raft_consensus.cc:604] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:35.948526 21880 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:35.950456 21319 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "909c8965e81d4f84a75ef2fd61bcbe72"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:35.952736 21319 raft_consensus.cc:604] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:35.956123 21164 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:35.956630 21164 raft_consensus.cc:604] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:35.957684 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20250109 21:10:35.961691 21248 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:35.962754 22372 raft_consensus.cc:988] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:35.963268 22372 raft_consensus.cc:1076] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:35.964977 21881 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58774
I20250109 21:10:35.965553 21881 raft_consensus.cc:491] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:35.965907 21881 raft_consensus.cc:3054] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.965984 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:35.971714 21319 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:35.974661 21881 raft_consensus.cc:513] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:35.977808 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:35.978333 21164 raft_consensus.cc:3054] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:35.978900 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:35.984817 21164 raft_consensus.cc:2463] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:35.986006 21843 leader_election.cc:304] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:35.986969 22360 raft_consensus.cc:2798] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:35.987432 22360 raft_consensus.cc:695] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:35.988178 22360 consensus_queue.cc:237] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:35.993732 21881 leader_election.cc:290] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:36.001166 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5bb0a4ab14fe49cd9d565ffe64396929" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:36.001998 21320 raft_consensus.cc:3049] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:36.004734 21320 raft_consensus.cc:738] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:36.005777 21320 consensus_queue.cc:260] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.013829 21320 raft_consensus.cc:3054] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.019387 21320 raft_consensus.cc:2463] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:36.050397 21065 catalog_manager.cc:5526] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.074260 21066 catalog_manager.cc:5526] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 2 to 3, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 3 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:36.099195 22335 raft_consensus.cc:1059] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:36.101431 22335 consensus_queue.cc:237] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.112659 21069 catalog_manager.cc:5526] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:36.110487 21320 consensus_queue.cc:237] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.118765 21164 consensus_queue.cc:237] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.123392 21878 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:36.124255 21166 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:36.130600 22336 raft_consensus.cc:988] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:36.150127 22336 raft_consensus.cc:1076] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:36.135171 22377 raft_consensus.cc:988] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:36.151410 22377 raft_consensus.cc:1076] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:36.151860 22288 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:36.153584 22307 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:36.154678 21322 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:36.155319 21322 raft_consensus.cc:491] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:36.155668 21322 raft_consensus.cc:3054] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.159322 21320 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58542
I20250109 21:10:36.160115 21320 raft_consensus.cc:491] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:36.160657 21320 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.160396 22307 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.167814 21166 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.178103 21878 raft_consensus.cc:2949] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.182214 21322 raft_consensus.cc:513] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:36.195124 21881 raft_consensus.cc:1270] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:36.194474 21066 catalog_manager.cc:5526] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.195782 21243 raft_consensus.cc:1270] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:36.196710 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet f75eb10b9fad472794f2398d9f305706 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:36.206236 22260 consensus_queue.cc:1035] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:36.198077 22277 raft_consensus.cc:988] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:36.207162 22277 raft_consensus.cc:1076] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:36.209408 22377 consensus_queue.cc:1035] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:36.209561 21880 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "61283e0a72e04a589880431a717f04f3"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58790
I20250109 21:10:36.210114 21880 raft_consensus.cc:491] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:36.210430 21880 raft_consensus.cc:3054] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.213440 21878 raft_consensus.cc:1270] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:36.216230 21164 raft_consensus.cc:1270] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:36.217890 22166 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:36.221450 22377 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.226070 22243 raft_consensus.cc:988] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:36.226442 22243 raft_consensus.cc:1076] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:36.227214 22336 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:36.219753 21880 raft_consensus.cc:513] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.229341 21878 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "909c8965e81d4f84a75ef2fd61bcbe72"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58774
I20250109 21:10:36.201747 21320 raft_consensus.cc:513] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:36.230737 21242 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.231487 21879 raft_consensus.cc:2949] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.233904 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet f75eb10b9fad472794f2398d9f305706 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:36.234483 21164 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61283e0a72e04a589880431a717f04f3" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:36.235036 21164 raft_consensus.cc:3049] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:36.235312 21164 raft_consensus.cc:738] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:36.235939 21164 consensus_queue.cc:260] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.230520 21878 raft_consensus.cc:491] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:36.237027 21878 raft_consensus.cc:3054] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.248252 21164 raft_consensus.cc:3054] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.248112 21319 raft_consensus.cc:1270] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:36.249635 21880 leader_election.cc:290] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:36.250272 21320 leader_election.cc:290] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:36.251682 21242 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:36.252254 21242 raft_consensus.cc:3049] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:36.252594 21242 raft_consensus.cc:738] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:36.252789 22248 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:36.250708 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "61283e0a72e04a589880431a717f04f3" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:36.253818 21243 raft_consensus.cc:3054] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.251438 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:36.257467 21165 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.264070 21242 consensus_queue.cc:260] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:36.292093 21878 raft_consensus.cc:513] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.294378 21248 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:10:36.297047 22243 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:36.309319 21170 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909c8965e81d4f84a75ef2fd61bcbe72" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:36.309959 21170 raft_consensus.cc:3054] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.316143 21322 leader_election.cc:290] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:36.317821 21242 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.317873 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:36.318472 21248 raft_consensus.cc:3054] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.319659 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b920d950f0d3444d9fff00a1bad09dc6" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:36.320309 21171 raft_consensus.cc:3049] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:36.320655 21171 raft_consensus.cc:738] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:36.321455 21171 consensus_queue.cc:260] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:36.322569 21171 raft_consensus.cc:3054] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.329366 21878 leader_election.cc:290] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:36.329797 21164 raft_consensus.cc:2463] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:36.332048 21843 leader_election.cc:304] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:36.331485 21242 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:36.335214 21319 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "909c8965e81d4f84a75ef2fd61bcbe72" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:36.335770 21319 raft_consensus.cc:3049] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:36.336064 21319 raft_consensus.cc:738] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:36.336993 21066 catalog_manager.cc:5526] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.338649 21165 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:36.339303 21168 raft_consensus.cc:1235] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Rejecting Update request from peer f5d1eaae36f84176860e3799d49e4f53 for earlier term 1. Current term is 2. Ops: []
I20250109 21:10:36.332603 21248 raft_consensus.cc:2463] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:36.341338 21319 consensus_queue.cc:260] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.343791 21319 raft_consensus.cc:3054] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.346467 22333 raft_consensus.cc:2798] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:36.346943 22333 raft_consensus.cc:695] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:36.347743 22333 consensus_queue.cc:237] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.353497 21170 raft_consensus.cc:2463] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:36.355234 21843 leader_election.cc:304] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
W20250109 21:10:36.360575 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 94256.6us
I20250109 21:10:36.365952 21171 raft_consensus.cc:2463] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:36.365612 21243 raft_consensus.cc:2463] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:36.369529 21319 raft_consensus.cc:2463] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:36.371191 22325 raft_consensus.cc:2798] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:36.380651 22325 raft_consensus.cc:695] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:36.381536 22325 consensus_queue.cc:237] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.387250 22384 tablet_replica.cc:331] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:36.388391 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 6f7c70db395b4c95bdd3a519fbff09f1 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:36.388478 22384 raft_consensus.cc:2238] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:36.395761 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 6f7c70db395b4c95bdd3a519fbff09f1 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:36.400281 22248 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.403118 22384 raft_consensus.cc:2267] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:36.421746 22384 ts_tablet_manager.cc:1905] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:36.430909 21169 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:36.432561 22325 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20250109 21:10:36.466078 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:33191, user_credentials={real_user=slave}} blocked reactor thread for 133164us
I20250109 21:10:36.436959 21169 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.470588 21168 raft_consensus.cc:1235] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Rejecting Update request from peer 0175ef2fbd0349568ba2bf83788476ea for earlier term 1. Current term is 2. Ops: []
I20250109 21:10:36.482786 21878 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.511890 21068 catalog_manager.cc:5526] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:36.519989 21881 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Advancing to term 3
I20250109 21:10:36.523473 22390 tablet_replica.cc:331] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:36.524507 22390 raft_consensus.cc:2238] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:36.525296 22390 raft_consensus.cc:2267] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:36.530346 22390 ts_tablet_manager.cc:1905] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:36.561379 21881 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:10:36.566291 21288 leader_election.cc:304] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
W20250109 21:10:36.572578 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 174971us
I20250109 21:10:36.574815 21288 leader_election.cc:304] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:36.581372 22388 raft_consensus.cc:2798] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:36.581946 22388 raft_consensus.cc:695] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:36.582765 22388 consensus_queue.cc:237] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:36.581377 22307 raft_consensus.cc:2798] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:36.588613 21169 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:10:36.684836 22307 raft_consensus.cc:695] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:36.685730 22307 consensus_queue.cc:237] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:36.687541 22384 ts_tablet_manager.cc:1918] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:36.688050 22384 log.cc:1198] T f75eb10b9fad472794f2398d9f305706 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/f75eb10b9fad472794f2398d9f305706
W20250109 21:10:36.697069 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 111123us
I20250109 21:10:36.698523 21066 catalog_manager.cc:5526] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:36.699687 21322 raft_consensus.cc:1270] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:36.742556 21322 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
W20250109 21:10:36.747051 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:33191, user_credentials={real_user=slave}} blocked reactor thread for 47274.2us
I20250109 21:10:36.748399 22342 raft_consensus.cc:988] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:36.748803 22342 raft_consensus.cc:1076] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:36.754422 21166 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:36.755846 22333 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:36.757341 22333 consensus_queue.cc:1035] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:36.758450 22307 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:36.759433 22243 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:36.764611 21068 catalog_manager.cc:5526] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:36.767845 21881 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7a4ca66c3087428aaf05f37bc1ba32ee"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58774
I20250109 21:10:36.768359 21881 raft_consensus.cc:491] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:36.768675 21881 raft_consensus.cc:3054] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.779644 22388 raft_consensus.cc:1059] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:36.782660 22388 consensus_queue.cc:237] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 3, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.771844 21066 catalog_manager.cc:5526] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:36.791280 22390 ts_tablet_manager.cc:1918] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:36.791721 22390 log.cc:1198] T 6f7c70db395b4c95bdd3a519fbff09f1 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/6f7c70db395b4c95bdd3a519fbff09f1
I20250109 21:10:36.795715 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 6f7c70db395b4c95bdd3a519fbff09f1 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:36.795817 21246 raft_consensus.cc:1270] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:36.797962 22325 consensus_queue.cc:1035] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:36.800860 21881 raft_consensus.cc:513] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.804416 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a4ca66c3087428aaf05f37bc1ba32ee" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:36.804970 21321 raft_consensus.cc:3049] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:36.805337 21321 raft_consensus.cc:738] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:36.806149 21321 consensus_queue.cc:260] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.807458 21321 raft_consensus.cc:3054] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.808961 21879 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250109 21:10:36.810189 22372 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:36.812067 21169 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250109 21:10:36.821069 22372 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:36.829958 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7a4ca66c3087428aaf05f37bc1ba32ee" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:36.830370 21243 raft_consensus.cc:3054] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:36.830703 21066 catalog_manager.cc:5526] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:36.838308 21321 raft_consensus.cc:2463] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:36.845796 21844 leader_election.cc:304] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:36.847520 22325 raft_consensus.cc:2798] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:36.847898 22325 raft_consensus.cc:695] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
W20250109 21:10:36.848472 22397 log.cc:926] Time spent T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea: Append to log took a long time: real 0.120s user 0.001s sys 0.000s
I20250109 21:10:36.848754 22325 consensus_queue.cc:237] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.849790 21881 leader_election.cc:290] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:36.851279 22372 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.859333 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet f75eb10b9fad472794f2398d9f305706 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:36.861940 21243 raft_consensus.cc:2463] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:36.861327 21166 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.871212 21248 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250109 21:10:36.874495 21066 catalog_manager.cc:5526] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:36.889878 21068 catalog_manager.cc:5526] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.890295 21881 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.905661 22342 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:36.908713 21321 consensus_queue.cc:237] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 3.5, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.912408 21881 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250109 21:10:36.913406 22342 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250109 21:10:36.915918 21243 consensus_queue.cc:237] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:36.920874 21169 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250109 21:10:36.918764 22401 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.920500 21879 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.931753 21321 raft_consensus.cc:1270] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:36.923887 21248 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 2 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.935490 21881 raft_consensus.cc:1270] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:36.936718 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet ec98ab18b5ba44949aeef1a8a519bb67 with cas_config_opid_index 5: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:36.938164 22372 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250109 21:10:36.938977 22395 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:36.940732 22395 consensus_queue.cc:1035] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:36.943431 21066 catalog_manager.cc:5526] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 5 to 6, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 3 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.949059 22391 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.950279 21322 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.964473 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 33a9dea3cbbb40abbdf4eb26e597f857 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:36.965221 21879 raft_consensus.cc:2949] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.969401 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet ec98ab18b5ba44949aeef1a8a519bb67 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 6) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:36.970713 22384 tablet_replica.cc:331] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:36.971647 22384 raft_consensus.cc:2238] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:36.972360 22384 raft_consensus.cc:2267] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:36.975658 22384 ts_tablet_manager.cc:1905] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:36.977579 21069 catalog_manager.cc:5526] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.985719 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet 33a9dea3cbbb40abbdf4eb26e597f857 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:36.987181 22409 tablet_replica.cc:331] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:36.986958 21169 raft_consensus.cc:2949] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Committing config change with OpId 3.6: config changed from index 5 to 6, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:36.988229 22409 raft_consensus.cc:2238] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:36.993669 22409 raft_consensus.cc:2267] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:36.996421 22409 ts_tablet_manager.cc:1905] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:37.011878 21166 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.013324 22325 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.021328 21322 raft_consensus.cc:1270] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.022761 22325 consensus_queue.cc:1035] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.025879 22384 ts_tablet_manager.cc:1918] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 3.5
I20250109 21:10:37.026533 22384 log.cc:1198] T ec98ab18b5ba44949aeef1a8a519bb67 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/ec98ab18b5ba44949aeef1a8a519bb67
I20250109 21:10:37.028254 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet ec98ab18b5ba44949aeef1a8a519bb67 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:37.038139 22409 ts_tablet_manager.cc:1918] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:37.038575 22409 log.cc:1198] T 33a9dea3cbbb40abbdf4eb26e597f857 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/33a9dea3cbbb40abbdf4eb26e597f857
I20250109 21:10:37.040273 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet 33a9dea3cbbb40abbdf4eb26e597f857 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:37.074805 21248 raft_consensus.cc:1270] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:37.081888 22401 consensus_queue.cc:1035] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:37.090376 21166 raft_consensus.cc:1270] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:37.091894 22372 consensus_queue.cc:1035] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:37.094192 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:37.132815 21248 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:37.133242 21248 raft_consensus.cc:604] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:37.135131 21322 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:37.135557 21322 raft_consensus.cc:604] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:37.137240 21166 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:37.137684 21166 raft_consensus.cc:604] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:37.139364 21322 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:37.139711 21322 raft_consensus.cc:604] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:37.141207 21322 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:37.141573 21322 raft_consensus.cc:604] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:37.143155 21166 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:37.143607 21166 raft_consensus.cc:604] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:37.144476 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 6
I20250109 21:10:37.145712 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:37.146158 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:37.160876 22372 raft_consensus.cc:988] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:37.161290 22388 raft_consensus.cc:1076] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:37.162457 21879 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58774
I20250109 21:10:37.162839 21879 raft_consensus.cc:491] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:37.163195 21879 raft_consensus.cc:3054] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.167578 21879 raft_consensus.cc:513] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.169734 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:37.170215 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "44dc7037c0cc4926b2e36fab2a05a11a" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:37.170302 21166 raft_consensus.cc:3054] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.171386 21322 raft_consensus.cc:3049] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:37.171706 21322 raft_consensus.cc:738] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:37.170828 21879 leader_election.cc:290] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:37.172456 21322 consensus_queue.cc:260] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.174374 21322 raft_consensus.cc:3054] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.176301 21169 raft_consensus.cc:1270] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:37.177562 22372 consensus_queue.cc:1035] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:37.178261 21166 raft_consensus.cc:2463] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:37.179214 21843 leader_election.cc:304] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:37.180455 22325 raft_consensus.cc:2798] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:37.180860 22325 raft_consensus.cc:695] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:37.181772 22325 consensus_queue.cc:237] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.186645 21248 raft_consensus.cc:1270] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:37.186998 21322 raft_consensus.cc:2463] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:37.188894 22372 consensus_queue.cc:1035] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:37.205312 21069 catalog_manager.cc:5526] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:37.249502 22377 raft_consensus.cc:988] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:37.249922 22377 raft_consensus.cc:1076] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:37.251205 21322 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:37.251624 21322 raft_consensus.cc:491] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:37.251899 21322 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.256646 21322 raft_consensus.cc:513] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:37.257823 21322 leader_election.cc:290] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:37.258368 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:37.258702 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:37.258890 21166 raft_consensus.cc:3049] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:37.259368 21166 raft_consensus.cc:738] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:37.259387 21248 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.260077 21166 consensus_queue.cc:260] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:37.261142 21166 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.263957 21248 raft_consensus.cc:2463] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:37.264982 21288 leader_election.cc:304] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:37.265623 22388 raft_consensus.cc:2798] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:37.266045 22388 raft_consensus.cc:695] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:37.266527 21166 raft_consensus.cc:2463] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:37.266788 22388 consensus_queue.cc:237] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:37.278173 21066 catalog_manager.cc:5526] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:37.291705 22379 raft_consensus.cc:988] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:37.292083 22377 raft_consensus.cc:1076] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:37.293334 21879 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58790
I20250109 21:10:37.293820 21879 raft_consensus.cc:491] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:37.294137 21879 raft_consensus.cc:3054] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.299324 21879 raft_consensus.cc:513] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.300470 21879 leader_election.cc:290] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:37.301229 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:37.301754 21166 raft_consensus.cc:3049] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:37.302047 21166 raft_consensus.cc:738] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:37.302620 21166 consensus_queue.cc:260] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.304220 21166 raft_consensus.cc:3054] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.306058 21321 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.307135 22333 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.308593 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8b90fd0d512143d7ba14c703e675aeaf" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:37.309166 21243 raft_consensus.cc:3054] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.310988 21166 raft_consensus.cc:2463] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:37.311900 21843 leader_election.cc:304] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:37.312601 22333 raft_consensus.cc:2798] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:37.313000 22333 raft_consensus.cc:695] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:37.313688 22333 consensus_queue.cc:237] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.314743 21243 raft_consensus.cc:2463] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:37.317356 21248 raft_consensus.cc:1270] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.319175 22325 consensus_queue.cc:1035] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:10:37.331434 21068 catalog_manager.cc:5526] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:37.414248 22166 raft_consensus.cc:988] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:37.414636 22391 raft_consensus.cc:1076] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:37.415729 21322 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58542
I20250109 21:10:37.416126 21322 raft_consensus.cc:491] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:37.416363 21322 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.420337 21322 raft_consensus.cc:513] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.421607 21322 leader_election.cc:290] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191)
I20250109 21:10:37.422461 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:37.422557 21879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
I20250109 21:10:37.423202 21243 raft_consensus.cc:3049] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:37.423239 21879 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.424350 21243 raft_consensus.cc:738] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:37.425071 22372 raft_consensus.cc:988] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:37.425585 22372 raft_consensus.cc:1076] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:37.425117 21243 consensus_queue.cc:260] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.426818 21881 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58774
I20250109 21:10:37.427253 21881 raft_consensus.cc:491] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:37.427362 21243 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.427585 21881 raft_consensus.cc:3054] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.429181 21879 raft_consensus.cc:2463] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:37.430136 21288 leader_election.cc:304] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:37.430707 22372 raft_consensus.cc:2798] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:37.431118 22372 raft_consensus.cc:695] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:37.431959 22372 consensus_queue.cc:237] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.435020 21243 raft_consensus.cc:2463] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:37.436080 21881 raft_consensus.cc:513] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.437985 21881 leader_election.cc:290] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:37.438174 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:37.438488 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9add3f091006404a8cbf90aef76b0c5d" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:37.438715 21243 raft_consensus.cc:3054] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.439010 21322 raft_consensus.cc:3049] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:37.439285 21322 raft_consensus.cc:738] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:37.440037 21322 consensus_queue.cc:260] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.441215 21322 raft_consensus.cc:3054] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.444262 21243 raft_consensus.cc:2463] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:37.445114 21843 leader_election.cc:304] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:37.445151 21069 catalog_manager.cc:5526] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:37.445930 22333 raft_consensus.cc:2798] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:37.446403 22333 raft_consensus.cc:695] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:37.446681 21322 raft_consensus.cc:2463] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:37.447227 22333 consensus_queue.cc:237] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:37.455700 21069 catalog_manager.cc:5526] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:37.477030 22388 raft_consensus.cc:988] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:37.477515 22372 raft_consensus.cc:1076] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:37.478708 21243 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:37.479151 21243 raft_consensus.cc:491] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:37.479460 21243 raft_consensus.cc:3054] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.483510 21243 raft_consensus.cc:513] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:37.484720 21243 leader_election.cc:290] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:37.485401 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:37.485556 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c941548822ea4678abcf5c764a2d24a4" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:37.485980 21166 raft_consensus.cc:3054] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.486089 21322 raft_consensus.cc:3049] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:37.486399 21322 raft_consensus.cc:738] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:37.486934 21322 consensus_queue.cc:260] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:37.487733 21322 raft_consensus.cc:3054] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:37.490140 21166 raft_consensus.cc:2463] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:37.491019 21213 leader_election.cc:304] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:37.491767 22391 raft_consensus.cc:2798] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:37.492166 22391 raft_consensus.cc:695] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:37.492079 21322 raft_consensus.cc:2463] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:37.493016 22391 consensus_queue.cc:237] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:37.502554 21069 catalog_manager.cc:5526] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:37.603210 21166 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.604893 22333 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.613734 21321 raft_consensus.cc:1270] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.615458 22325 consensus_queue.cc:1035] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.647589 21166 raft_consensus.cc:1270] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:37.648613 22372 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:37.656172 21243 raft_consensus.cc:1270] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:37.657125 22388 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:37.756544 21166 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.757442 22325 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.767416 21248 raft_consensus.cc:1270] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.768764 22325 consensus_queue.cc:1035] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.867882 21879 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.870666 22372 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.880890 21322 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.881956 22360 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.905472 21243 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.906684 21248 raft_consensus.cc:1270] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:37.908030 22325 consensus_queue.cc:1035] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:37.909642 22388 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.002s
I20250109 21:10:37.925282 21169 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:37.926473 22166 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:37.935372 21322 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:37.937595 22391 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:38.024963 21322 consensus_queue.cc:237] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.029736 21243 raft_consensus.cc:1270] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:38.030139 21166 raft_consensus.cc:1270] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:38.030421 21288 consensus_peers.cc:487] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 80bbbef4a3bd4a8789ff1a631b7f36e4. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:38.031584 22342 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:38.033288 22342 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:38.041323 22388 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.042868 21243 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.048050 21166 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.056824 21248 consensus_queue.cc:237] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.068784 21069 catalog_manager.cc:5526] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.078482 21322 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:38.079972 22391 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250109 21:10:38.088680 21213 consensus_peers.cc:487] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a822be40fe74d1a8c6ab5aec62bcb14. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:38.090777 21166 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:38.092062 22436 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:38.098896 22393 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.100556 21322 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.102823 21166 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.129069 21248 consensus_queue.cc:237] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.139181 21066 catalog_manager.cc:5526] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.147511 21322 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:38.148962 22391 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250109 21:10:38.154050 21213 consensus_peers.cc:487] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: abb16506c36a4e58a36455d201947d07. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:38.154688 21166 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:38.156726 22391 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:38.163384 22436 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.170285 21322 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.178489 21171 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.183619 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:38.186750 21248 consensus_queue.cc:237] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.194269 21069 catalog_manager.cc:5526] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.213582 21322 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20250109 21:10:38.214959 21213 consensus_peers.cc:487] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c0107e66d7794efeb3ab5f03388ecae1. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:38.216711 22166 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:38.218907 21171 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:38.220307 22436 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:38.227291 22393 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.228824 21320 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.245458 21066 catalog_manager.cc:5526] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.252475 21171 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:38.284217 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1fa09aa7e53c4ba9a22836b10b7a8446"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:38.284866 21320 raft_consensus.cc:604] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:38.286857 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:38.287303 21320 raft_consensus.cc:604] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Received request to transfer leadership to TS 1774487f18694af1a5340fc8486cff53
I20250109 21:10:38.289773 21248 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:38.290284 21248 raft_consensus.cc:604] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:38.292605 21171 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:38.293079 21171 raft_consensus.cc:604] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:38.296403 21243 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:38.296872 21243 raft_consensus.cc:604] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Received request to transfer leadership to TS 1774487f18694af1a5340fc8486cff53
I20250109 21:10:38.301000 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250109 21:10:38.302431 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:38.303040 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:38.504714 22393 raft_consensus.cc:988] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:38.505163 22436 raft_consensus.cc:1076] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Signalling peer 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:38.506500 21169 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:43836
I20250109 21:10:38.506929 21169 raft_consensus.cc:491] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:38.507198 21169 raft_consensus.cc:3054] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.512229 21169 raft_consensus.cc:513] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.513685 21169 leader_election.cc:290] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:38.515162 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:38.515794 21246 raft_consensus.cc:3049] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:38.516093 21246 raft_consensus.cc:738] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:38.515251 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8a822be40fe74d1a8c6ab5aec62bcb14" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:38.516956 21320 raft_consensus.cc:3054] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.516831 21246 consensus_queue.cc:260] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.517961 21246 raft_consensus.cc:3054] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.521390 21320 raft_consensus.cc:2463] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 2.
I20250109 21:10:38.521907 21246 raft_consensus.cc:2463] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 2.
I20250109 21:10:38.522377 21137 leader_election.cc:304] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:38.523077 22379 raft_consensus.cc:2798] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:38.523442 22379 raft_consensus.cc:695] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:38.524184 22379 consensus_queue.cc:237] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.534121 21065 catalog_manager.cc:5526] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 1 to 2, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:38.547463 22372 raft_consensus.cc:988] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:38.547947 22441 raft_consensus.cc:1076] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:38.549093 21881 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1fa09aa7e53c4ba9a22836b10b7a8446"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58774
I20250109 21:10:38.549739 21881 raft_consensus.cc:491] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:38.550057 21881 raft_consensus.cc:3054] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.556046 21881 raft_consensus.cc:513] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:38.557593 21881 leader_election.cc:290] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:38.558887 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa09aa7e53c4ba9a22836b10b7a8446" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:38.559378 21321 raft_consensus.cc:3049] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:38.559244 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1fa09aa7e53c4ba9a22836b10b7a8446" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:38.559646 21321 raft_consensus.cc:738] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:38.559818 21248 raft_consensus.cc:3054] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.560343 21321 consensus_queue.cc:260] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:38.561224 21321 raft_consensus.cc:3054] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.566008 21248 raft_consensus.cc:2463] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:38.571511 21843 leader_election.cc:304] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:38.571727 22455 ts_tablet_manager.cc:927] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:38.572228 22360 raft_consensus.cc:2798] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:38.572705 22360 raft_consensus.cc:695] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:38.573071 21321 raft_consensus.cc:2463] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:38.573503 22360 consensus_queue.cc:237] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:38.580322 22455 tablet_copy_client.cc:323] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:38.581617 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:38.582136 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-80bbbef4a3bd4a8789ff1a631b7f36e4
I20250109 21:10:38.589234 21065 catalog_manager.cc:5526] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:38.591454 21334 tablet_copy_source_session.cc:215] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:38.593993 22455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:38.618902 22455 tablet_copy_client.cc:806] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:38.619515 22455 tablet_copy_client.cc:670] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:38.623203 22436 raft_consensus.cc:988] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:38.623660 22436 raft_consensus.cc:1076] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:38.625133 21321 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58542
I20250109 21:10:38.625272 22455 tablet_copy_client.cc:538] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:38.625720 21321 raft_consensus.cc:491] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:38.626410 21321 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.632939 21321 raft_consensus.cc:513] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.633330 22455 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:38.634721 21321 leader_election.cc:290] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:38.635608 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:38.635905 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:38.636226 21248 raft_consensus.cc:3049] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:38.636427 21171 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.636595 21248 raft_consensus.cc:738] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:38.637383 21248 consensus_queue.cc:260] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.638532 21248 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.639560 22441 raft_consensus.cc:988] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:38.640012 22441 raft_consensus.cc:1076] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Signalling peer 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:38.642699 21171 raft_consensus.cc:2463] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:38.645368 21166 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:43824
I20250109 21:10:38.645457 21248 raft_consensus.cc:2463] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:38.645931 21166 raft_consensus.cc:491] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:38.646353 21166 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:38.652670 21288 leader_election.cc:304] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:38.657856 22372 raft_consensus.cc:2798] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:38.669041 21166 raft_consensus.cc:513] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.671507 21166 leader_election.cc:290] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 3 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:38.671904 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:38.672538 21321 raft_consensus.cc:3049] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:38.672854 21321 raft_consensus.cc:738] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:38.674430 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:38.674969 21246 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:38.673755 21321 consensus_queue.cc:260] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.686416 21321 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:38.688910 21246 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 3.
I20250109 21:10:38.690017 21136 leader_election.cc:304] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:38.690727 22377 raft_consensus.cc:2798] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:38.691200 22377 raft_consensus.cc:695] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:38.691906 22372 raft_consensus.cc:695] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:38.691964 22377 consensus_queue.cc:237] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.693102 22372 consensus_queue.cc:237] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.700536 21321 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 3.
I20250109 21:10:38.702080 22455 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:38.709061 21065 catalog_manager.cc:5526] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:38.711360 22455 tablet_bootstrap.cc:492] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:38.712013 22455 ts_tablet_manager.cc:1397] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.079s user 0.029s sys 0.011s
I20250109 21:10:38.714542 22455 raft_consensus.cc:357] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.717600 22455 raft_consensus.cc:738] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:38.718210 22455 consensus_queue.cc:260] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.725836 22455 ts_tablet_manager.cc:1428] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.014s user 0.005s sys 0.002s
I20250109 21:10:38.726076 21066 catalog_manager.cc:5526] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 2 to 3, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:38.727156 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-80bbbef4a3bd4a8789ff1a631b7f36e4 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:38.727586 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-80bbbef4a3bd4a8789ff1a631b7f36e4 on tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:38.748838 22455 ts_tablet_manager.cc:927] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:38.750252 22455 tablet_copy_client.cc:323] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:38.751412 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet c0107e66d7794efeb3ab5f03388ecae1 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:38.751869 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet c0107e66d7794efeb3ab5f03388ecae1 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-c0107e66d7794efeb3ab5f03388ecae1
I20250109 21:10:38.758013 21258 tablet_copy_source_session.cc:215] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:38.760763 22455 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c0107e66d7794efeb3ab5f03388ecae1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:38.760841 22377 raft_consensus.cc:988] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:38.761294 22377 raft_consensus.cc:1076] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:38.762682 21320 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:38.763111 21320 raft_consensus.cc:491] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:38.763367 21320 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.768042 21320 raft_consensus.cc:513] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.770475 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:38.771016 21171 raft_consensus.cc:3049] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:38.771303 21171 raft_consensus.cc:738] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:38.771950 21171 consensus_queue.cc:260] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.772939 21171 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.773936 21320 leader_election.cc:290] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:38.775331 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:38.776204 21248 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:38.780289 22455 tablet_copy_client.cc:806] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:38.780802 22455 tablet_copy_client.cc:670] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:38.783160 21171 raft_consensus.cc:2463] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:38.784222 21288 leader_election.cc:304] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:38.784605 22455 tablet_copy_client.cc:538] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:38.784916 22372 raft_consensus.cc:2798] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:38.785427 22372 raft_consensus.cc:695] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:38.786183 22372 consensus_queue.cc:237] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:38.787513 21248 raft_consensus.cc:2463] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:38.789215 22464 ts_tablet_manager.cc:927] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:38.805047 22455 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:38.813781 22464 tablet_copy_client.cc:323] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:38.816151 21066 catalog_manager.cc:5526] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:38.818601 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet abb16506c36a4e58a36455d201947d07 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:38.819242 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet abb16506c36a4e58a36455d201947d07 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-abb16506c36a4e58a36455d201947d07
I20250109 21:10:38.830145 22455 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:38.831043 22455 tablet_bootstrap.cc:492] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:38.831455 21258 tablet_copy_source_session.cc:215] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:38.831670 22455 ts_tablet_manager.cc:1397] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.027s user 0.022s sys 0.004s
I20250109 21:10:38.834280 22464 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet abb16506c36a4e58a36455d201947d07. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:38.834316 22455 raft_consensus.cc:357] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.835215 22455 raft_consensus.cc:738] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:38.835726 22455 consensus_queue.cc:260] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.837604 22455 ts_tablet_manager.cc:1428] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:10:38.841226 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-c0107e66d7794efeb3ab5f03388ecae1 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:38.842061 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-c0107e66d7794efeb3ab5f03388ecae1 on tablet c0107e66d7794efeb3ab5f03388ecae1 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:38.851574 22464 tablet_copy_client.cc:806] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:38.852300 22464 tablet_copy_client.cc:670] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:38.855549 22464 tablet_copy_client.cc:538] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:38.868588 22464 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:38.894426 22464 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:38.895190 22464 tablet_bootstrap.cc:492] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:38.895723 22464 ts_tablet_manager.cc:1397] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.014s
I20250109 21:10:38.898228 22464 raft_consensus.cc:357] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.898877 22464 raft_consensus.cc:738] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:38.899487 22464 consensus_queue.cc:260] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:38.901877 22464 ts_tablet_manager.cc:1428] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20250109 21:10:38.903550 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-abb16506c36a4e58a36455d201947d07 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:38.903949 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-abb16506c36a4e58a36455d201947d07 on tablet abb16506c36a4e58a36455d201947d07 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:38.950259 21881 raft_consensus.cc:1212] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:38.998126 21246 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:38.999186 22460 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.009482 21321 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:39.010605 22471 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20250109 21:10:39.011919 21136 consensus_peers.cc:487] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 8a822be40fe74d1a8c6ab5aec62bcb14. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:39.101878 21248 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:39.102978 22360 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:39.115841 21320 raft_consensus.cc:1270] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:39.117025 22360 consensus_queue.cc:1035] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:39.180999 21881 raft_consensus.cc:1212] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250109 21:10:39.226775 21243 raft_consensus.cc:1270] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:39.228572 22372 consensus_queue.cc:1035] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:39.237915 21171 raft_consensus.cc:1270] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:39.239135 22372 consensus_queue.cc:1035] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:39.264010 21169 raft_consensus.cc:1270] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:39.264232 21243 raft_consensus.cc:1270] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:10:39.265336 22459 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:39.265583 22377 consensus_queue.cc:1035] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.279819 21248 raft_consensus.cc:1270] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:39.281085 22372 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:39.296747 21322 raft_consensus.cc:1270] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:10:39.297999 22379 consensus_queue.cc:1035] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.350327 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:39.351522 22342 raft_consensus.cc:1059] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:39.357441 22342 consensus_queue.cc:237] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:39.368145 21881 raft_consensus.cc:1212] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:39.395974 21879 raft_consensus.cc:1270] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:39.397691 22372 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.398104 21171 raft_consensus.cc:1270] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:39.402724 22372 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.403371 21246 raft_consensus.cc:1270] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:39.410163 22372 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.421106 22372 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.428092 21171 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:39.428687 21171 raft_consensus.cc:604] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:39.428280 21246 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.431246 21171 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.434221 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:39.434796 21320 raft_consensus.cc:604] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:39.435987 21879 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.444535 21066 catalog_manager.cc:5526] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.447165 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250109 21:10:39.449156 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:39.454701 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:39.474020 22377 raft_consensus.cc:988] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:39.474467 22377 raft_consensus.cc:1076] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:39.477344 21322 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:39.477838 21322 raft_consensus.cc:491] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:39.478178 21322 raft_consensus.cc:3054] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:39.486800 21320 consensus_queue.cc:237] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:39.488745 21322 raft_consensus.cc:513] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:39.492921 21322 leader_election.cc:290] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191)
I20250109 21:10:39.494740 22491 ts_tablet_manager.cc:927] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:39.494817 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:39.495426 21166 raft_consensus.cc:3049] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:39.495715 21166 raft_consensus.cc:738] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:39.496371 21166 consensus_queue.cc:260] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:39.497466 21166 raft_consensus.cc:3054] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:39.499178 21879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c77aca60924f40f68ecc7531984ef0cc" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
I20250109 21:10:39.499698 21879 raft_consensus.cc:3054] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:39.510856 21881 raft_consensus.cc:1270] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:39.512854 22372 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:39.514242 21166 raft_consensus.cc:2463] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:39.515862 22491 tablet_copy_client.cc:323] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:39.515816 21288 leader_election.cc:304] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:39.517659 22372 raft_consensus.cc:2798] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:39.518064 22372 raft_consensus.cc:695] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:39.518728 22372 consensus_queue.cc:237] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:39.520215 21879 raft_consensus.cc:2463] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:39.518074 21246 raft_consensus.cc:1270] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:39.523890 22459 consensus_queue.cc:1035] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:39.528777 22459 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.532019 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet 8a822be40fe74d1a8c6ab5aec62bcb14 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:39.532523 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet 8a822be40fe74d1a8c6ab5aec62bcb14 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-8a822be40fe74d1a8c6ab5aec62bcb14
I20250109 21:10:39.540271 21181 tablet_copy_source_session.cc:215] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:39.545840 22491 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8a822be40fe74d1a8c6ab5aec62bcb14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:39.540118 21248 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.539079 21881 raft_consensus.cc:2949] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.548215 21068 catalog_manager.cc:5526] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:39.563346 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:39.576701 22491 tablet_copy_client.cc:806] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:39.577306 22491 tablet_copy_client.cc:670] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:39.579886 21069 catalog_manager.cc:5526] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.584245 22491 tablet_copy_client.cc:538] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:39.593748 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:39.594188 22491 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:39.605996 22494 tablet_replica.cc:331] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:39.607017 22494 raft_consensus.cc:2238] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:39.608112 22494 raft_consensus.cc:2267] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:39.613701 22494 ts_tablet_manager.cc:1905] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:39.616267 22491 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:39.617025 22491 tablet_bootstrap.cc:492] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:39.617614 22491 ts_tablet_manager.cc:1397] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.024s user 0.014s sys 0.008s
I20250109 21:10:39.620105 22491 raft_consensus.cc:357] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:39.620934 22491 raft_consensus.cc:738] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:39.621538 22491 consensus_queue.cc:260] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:39.623876 22491 ts_tablet_manager.cc:1428] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250109 21:10:39.625712 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-8a822be40fe74d1a8c6ab5aec62bcb14 received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:39.626097 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-8a822be40fe74d1a8c6ab5aec62bcb14 on tablet 8a822be40fe74d1a8c6ab5aec62bcb14 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:39.628103 22494 ts_tablet_manager.cc:1918] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:39.628512 22494 log.cc:1198] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/80bbbef4a3bd4a8789ff1a631b7f36e4
I20250109 21:10:39.630118 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet 80bbbef4a3bd4a8789ff1a631b7f36e4 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:39.726655 22459 raft_consensus.cc:988] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:39.727195 22372 raft_consensus.cc:1076] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:39.728365 21248 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:39.728772 21248 raft_consensus.cc:491] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:39.729112 21248 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:39.734148 21248 raft_consensus.cc:513] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:39.735973 21248 leader_election.cc:290] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 3 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:39.736264 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:39.736475 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f8fab7dbf6344706915ff7ec21cc5430" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:39.736835 21171 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:39.737046 21322 raft_consensus.cc:3049] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:39.737273 21322 raft_consensus.cc:738] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:39.737767 21322 consensus_queue.cc:260] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:39.738689 21322 raft_consensus.cc:3054] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:39.741709 21171 raft_consensus.cc:2463] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 3.
I20250109 21:10:39.742933 21213 leader_election.cc:304] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:39.743645 22482 raft_consensus.cc:2798] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:39.744107 22482 raft_consensus.cc:695] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:39.744623 21322 raft_consensus.cc:2463] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 3.
I20250109 21:10:39.744920 22482 consensus_queue.cc:237] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:39.757004 21065 catalog_manager.cc:5526] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 2 to 3, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 3 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:39.791507 22482 raft_consensus.cc:1059] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:39.793387 22482 consensus_queue.cc:237] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:39.802547 21881 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:39.802776 21166 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:39.803104 21320 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:39.804234 22482 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:39.805197 22393 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:39.807385 22482 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:39.827131 22436 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.836787 21881 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.841642 21171 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.842288 21322 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.858071 21068 catalog_manager.cc:5526] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.881337 21243 consensus_queue.cc:237] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:39.885708 21322 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:39.886747 22501 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:39.889559 21881 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:39.893296 22501 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:39.896405 22436 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.898599 21320 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.911180 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet c0107e66d7794efeb3ab5f03388ecae1 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:39.914606 21066 catalog_manager.cc:5526] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:39.922513 21881 raft_consensus.cc:2949] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.927676 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet c0107e66d7794efeb3ab5f03388ecae1 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:39.928905 22494 tablet_replica.cc:331] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:39.929847 22494 raft_consensus.cc:2238] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:39.930460 22494 raft_consensus.cc:2267] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:39.933990 22494 ts_tablet_manager.cc:1905] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:39.938288 22436 raft_consensus.cc:1059] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:39.940786 22436 consensus_queue.cc:237] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:39.959365 22494 ts_tablet_manager.cc:1918] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250109 21:10:39.959758 22494 log.cc:1198] T c0107e66d7794efeb3ab5f03388ecae1 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/c0107e66d7794efeb3ab5f03388ecae1
I20250109 21:10:39.962652 21320 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:39.963750 21881 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:39.963877 21166 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:39.964139 22501 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.964951 22482 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.960974 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet c0107e66d7794efeb3ab5f03388ecae1 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:39.968336 22482 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:39.986935 22482 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.992805 21320 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.993465 21878 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:39.997184 21169 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.008747 21065 catalog_manager.cc:5526] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:40.033802 21246 consensus_queue.cc:237] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:40.048794 21881 raft_consensus.cc:1212] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Deduplicated request from leader. Original: 1.2->[2.3-2.3] Dedup: 2.3->[]
I20250109 21:10:40.064098 21878 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:40.067948 22501 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:40.074592 21881 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:40.075919 22487 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:40.076776 21166 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:40.078529 22391 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.080737 21881 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.091791 22436 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:40.094769 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet abb16506c36a4e58a36455d201947d07 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:40.097115 21169 raft_consensus.cc:2949] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.104001 21171 raft_consensus.cc:1270] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:40.115056 22487 consensus_queue.cc:1035] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:10:40.129271 21069 catalog_manager.cc:5526] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.135731 21168 raft_consensus.cc:1270] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:10:40.137291 22436 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:40.166996 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet abb16506c36a4e58a36455d201947d07 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:40.184679 22514 tablet_replica.cc:331] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:40.185914 22514 raft_consensus.cc:2238] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:40.186865 22514 raft_consensus.cc:2267] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:40.189337 21320 raft_consensus.cc:1270] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:10:40.191756 22514 ts_tablet_manager.cc:1905] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:40.193120 22482 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:40.231967 22514 ts_tablet_manager.cc:1918] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:40.232479 22514 log.cc:1198] T abb16506c36a4e58a36455d201947d07 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/abb16506c36a4e58a36455d201947d07
I20250109 21:10:40.234018 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet abb16506c36a4e58a36455d201947d07 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:40.496546 22379 raft_consensus.cc:1059] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:40.500033 22379 consensus_queue.cc:237] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:40.504758 21320 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:40.505983 21246 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:40.505887 22379 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:40.506167 21879 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:40.508769 22377 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:40.511603 22377 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:40.530043 22379 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.531446 21320 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.536409 21881 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.540637 21246 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.548262 21068 catalog_manager.cc:5526] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:40.557983 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:40.602775 21171 consensus_queue.cc:237] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:40.610286 21881 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:40.611564 21243 raft_consensus.cc:1270] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:40.612454 22460 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:40.616899 22460 consensus_queue.cc:1035] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:40.619890 22377 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.631352 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 8a822be40fe74d1a8c6ab5aec62bcb14 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:40.631565 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:40.632105 21320 raft_consensus.cc:604] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:40.632892 21881 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.638370 21243 raft_consensus.cc:2949] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:40.641678 21168 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:40.642200 21168 raft_consensus.cc:604] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:40.640744 21069 catalog_manager.cc:5526] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 4 to 5, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 2 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:40.647173 21246 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:40.647691 21246 raft_consensus.cc:604] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:40.651616 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:40.652154 21320 raft_consensus.cc:604] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:40.653337 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20250109 21:10:40.654966 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:40.655562 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:40.655637 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 8a822be40fe74d1a8c6ab5aec62bcb14 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:40.656453 22514 tablet_replica.cc:331] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:40.657318 22514 raft_consensus.cc:2238] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:40.657792 22514 raft_consensus.cc:2267] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:40.661027 22514 ts_tablet_manager.cc:1905] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:40.665026 22487 raft_consensus.cc:988] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:40.665468 22487 raft_consensus.cc:1076] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:40.667047 21246 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:40.667526 21246 raft_consensus.cc:491] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:40.667824 21246 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:40.675391 21246 raft_consensus.cc:513] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:40.676987 22514 ts_tablet_manager.cc:1918] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250109 21:10:40.677443 22514 log.cc:1198] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/8a822be40fe74d1a8c6ab5aec62bcb14
I20250109 21:10:40.678277 21246 leader_election.cc:290] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 3 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:40.678967 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:40.679289 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3991f36cf1024599a42cd83ea8bbd158" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:40.680924 21168 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:40.680176 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 8a822be40fe74d1a8c6ab5aec62bcb14 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:40.681170 21320 raft_consensus.cc:3049] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:40.683019 21320 raft_consensus.cc:738] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:40.683717 21320 consensus_queue.cc:260] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:40.684830 21320 raft_consensus.cc:3054] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:40.687783 21168 raft_consensus.cc:2463] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 3.
I20250109 21:10:40.689909 22377 raft_consensus.cc:988] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:40.690310 22377 raft_consensus.cc:1076] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:40.691504 21213 leader_election.cc:304] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:40.692210 22482 raft_consensus.cc:2798] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:40.692793 22482 raft_consensus.cc:695] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:40.693099 21322 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:40.693601 21322 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:40.693480 22482 consensus_queue.cc:237] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:40.693991 21322 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:40.702665 21322 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:40.702795 21069 catalog_manager.cc:5526] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 2 to 3, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 3 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:40.703892 21320 raft_consensus.cc:2463] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 3.
I20250109 21:10:40.705093 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:40.705588 21322 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 3 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:40.705663 21168 raft_consensus.cc:3049] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:40.706101 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:40.706188 21168 raft_consensus.cc:738] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:40.706698 21246 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:40.707082 21168 consensus_queue.cc:260] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:40.708109 21168 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:40.714810 21246 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 3.
I20250109 21:10:40.715883 21288 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:40.716867 22372 raft_consensus.cc:2798] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:40.717275 22372 raft_consensus.cc:695] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:40.717968 22372 consensus_queue.cc:237] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:40.721210 21168 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 3.
I20250109 21:10:40.729773 21069 catalog_manager.cc:5526] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 2 to 3, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 3 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:40.792958 22487 raft_consensus.cc:988] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:40.793371 22372 raft_consensus.cc:1076] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:40.794520 21881 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58774
I20250109 21:10:40.795006 21881 raft_consensus.cc:491] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:40.795375 21881 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:40.799662 21881 raft_consensus.cc:513] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:40.800854 21881 leader_election.cc:290] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 4 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:40.801434 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:40.801771 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec98ab18b5ba44949aeef1a8a519bb67" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:40.801975 21168 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:40.802367 21320 raft_consensus.cc:3049] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:10:40.802675 21320 raft_consensus.cc:738] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:40.803380 21320 consensus_queue.cc:260] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:40.804543 21320 raft_consensus.cc:3054] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:40.808372 21168 raft_consensus.cc:2463] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 4.
I20250109 21:10:40.809038 21320 raft_consensus.cc:2463] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 4.
I20250109 21:10:40.809280 21843 leader_election.cc:304] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:40.809909 22325 raft_consensus.cc:2798] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:10:40.810245 22325 raft_consensus.cc:695] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:40.810765 22325 consensus_queue.cc:237] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:40.818209 21069 catalog_manager.cc:5526] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 3 to 4, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 4 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 6 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:40.968112 22501 raft_consensus.cc:988] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:40.968572 22436 raft_consensus.cc:1076] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:40.969732 21320 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58542
I20250109 21:10:40.970202 21320 raft_consensus.cc:491] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:40.970446 21320 raft_consensus.cc:3054] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:40.976073 21320 raft_consensus.cc:513] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:40.978754 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:40.979211 21320 leader_election.cc:290] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191)
I20250109 21:10:40.979382 21243 raft_consensus.cc:3049] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:40.980026 21243 raft_consensus.cc:738] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:40.980648 21243 consensus_queue.cc:260] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:40.981528 21243 raft_consensus.cc:3054] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:40.981683 21879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c714104a3f784fa2a8dbab3a26b67e16" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
I20250109 21:10:40.982395 21879 raft_consensus.cc:3054] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:40.987938 21243 raft_consensus.cc:2463] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:40.989151 21288 leader_election.cc:304] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:40.989269 21879 raft_consensus.cc:2463] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:40.989959 22487 raft_consensus.cc:2798] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:40.990414 22487 raft_consensus.cc:695] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:40.991299 22487 consensus_queue.cc:237] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:41.001019 21069 catalog_manager.cc:5526] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:41.144937 21171 raft_consensus.cc:1270] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250109 21:10:41.146092 21243 raft_consensus.cc:1270] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250109 21:10:41.146242 22487 consensus_queue.cc:1035] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:41.147398 22342 consensus_queue.cc:1035] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:41.211951 21320 raft_consensus.cc:1270] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:10:41.213668 22436 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:41.223982 21171 raft_consensus.cc:1270] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:10:41.225306 22530 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:41.227962 21322 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20250109 21:10:41.230695 22360 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20250109 21:10:41.270315 21171 raft_consensus.cc:1270] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20250109 21:10:41.271812 22360 consensus_queue.cc:1035] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20250109 21:10:41.392055 21243 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:41.393165 22372 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:41.404582 21879 raft_consensus.cc:1270] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:41.407975 22372 consensus_queue.cc:1035] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:41.702544 21322 consensus_queue.cc:237] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
W20250109 21:10:41.709380 21288 consensus_peers.cc:487] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 65dabcea5fff4017b727f2fcdee56246. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:41.709522 21248 raft_consensus.cc:1270] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:41.711803 22537 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:41.712757 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:41.713577 21171 raft_consensus.cc:1270] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:41.727496 22537 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:41.757221 22487 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.761057 21248 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.782413 21322 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:41.783026 21322 raft_consensus.cc:604] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Received request to transfer leadership to TS 1774487f18694af1a5340fc8486cff53
I20250109 21:10:41.784613 21243 consensus_queue.cc:237] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:41.785005 21065 catalog_manager.cc:5526] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:41.780853 21171 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.799816 21322 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "bba485e8800045ec8e33924e02890beb"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:41.800371 21322 raft_consensus.cc:604] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:41.807976 21248 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:41.808705 21248 raft_consensus.cc:604] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:41.815703 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20250109 21:10:41.817569 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20250109 21:10:41.832595 21213 consensus_peers.cc:487] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 7e21bd94dd8648d09b26343df6230d65. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:41.834424 21322 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:41.839066 22436 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:41.839877 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:41.843289 21168 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:41.845279 22530 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:41.852600 22436 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.863859 21322 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.870241 22342 raft_consensus.cc:988] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:41.870723 22342 raft_consensus.cc:1076] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:41.874382 21248 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "bba485e8800045ec8e33924e02890beb"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:41.876009 21248 raft_consensus.cc:491] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:41.876356 21248 raft_consensus.cc:3054] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:41.890067 21168 consensus_queue.cc:237] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
W20250109 21:10:41.910152 21136 consensus_peers.cc:487] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b3b31fe68ef047b3b126d525dd19991d. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:41.901855 21069 catalog_manager.cc:5526] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:41.886600 21248 raft_consensus.cc:513] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:41.912969 21248 leader_election.cc:290] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:41.912993 21243 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:41.915367 22377 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:41.917016 21322 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba485e8800045ec8e33924e02890beb" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:41.917702 21322 raft_consensus.cc:3049] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:41.917974 21322 raft_consensus.cc:738] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:41.918679 21322 consensus_queue.cc:260] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:41.919405 21320 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:41.920022 21322 raft_consensus.cc:3054] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:41.927088 22436 raft_consensus.cc:988] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:41.931318 22379 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:41.933215 22379 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.933431 21168 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.938124 22530 raft_consensus.cc:1076] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:41.938580 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "bba485e8800045ec8e33924e02890beb" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:41.939967 21171 raft_consensus.cc:3054] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:41.939855 21316 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58542
I20250109 21:10:41.940645 21316 raft_consensus.cc:491] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:41.941079 21316 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:41.947352 21316 raft_consensus.cc:513] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:41.947578 21243 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.950287 21322 raft_consensus.cc:2463] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:41.952036 21214 leader_election.cc:304] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:41.954638 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:41.955217 21246 raft_consensus.cc:3049] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:41.955525 21246 raft_consensus.cc:738] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:41.955765 22436 raft_consensus.cc:2798] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:41.956151 21246 consensus_queue.cc:260] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:41.957469 21246 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:41.957624 22436 raft_consensus.cc:695] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:41.960819 21171 raft_consensus.cc:2463] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 2.
I20250109 21:10:41.960568 22436 consensus_queue.cc:237] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:41.966838 21248 consensus_queue.cc:237] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:41.964995 21320 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:41.971181 21316 leader_election.cc:290] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 3 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191)
I20250109 21:10:41.975391 21879 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c0107e66d7794efeb3ab5f03388ecae1" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
I20250109 21:10:41.975942 21879 raft_consensus.cc:3054] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:41.975169 21069 catalog_manager.cc:5526] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:41.978252 21246 raft_consensus.cc:2463] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 3.
I20250109 21:10:41.980784 21288 leader_election.cc:304] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:41.981580 22487 raft_consensus.cc:2798] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:41.982029 22487 raft_consensus.cc:695] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:41.982851 22487 consensus_queue.cc:237] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:41.994583 21168 raft_consensus.cc:1270] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
W20250109 21:10:41.995064 21213 consensus_peers.cc:487] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: e719827258244d4c9a82be8775a044f5. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:41.996035 21316 raft_consensus.cc:1270] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:41.996083 22530 consensus_queue.cc:1035] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:41.998484 22530 consensus_queue.cc:1035] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.012s
I20250109 21:10:42.019054 21065 catalog_manager.cc:5526] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 2 to 3, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 3 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:42.023238 21879 raft_consensus.cc:2463] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 3.
I20250109 21:10:42.017316 21069 catalog_manager.cc:5526] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:42.036803 22530 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:42.048411 21171 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:42.053740 21316 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:42.075455 21069 catalog_manager.cc:5526] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:42.093799 22372 raft_consensus.cc:988] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:42.094403 22487 raft_consensus.cc:1076] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Signalling peer 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:42.095638 21168 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:43824
I20250109 21:10:42.096072 21168 raft_consensus.cc:491] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:42.096364 21168 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:42.100831 21168 raft_consensus.cc:513] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:42.102473 21168 leader_election.cc:290] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 3 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:42.103071 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:42.103639 21248 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:42.103852 21316 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:42.104357 21316 raft_consensus.cc:3049] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:42.104677 21316 raft_consensus.cc:738] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:42.105448 21316 consensus_queue.cc:260] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:42.107070 21316 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:42.111680 21248 raft_consensus.cc:2463] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 3.
I20250109 21:10:42.112775 21316 raft_consensus.cc:2463] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 3.
I20250109 21:10:42.113675 21137 leader_election.cc:304] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53; no voters:
I20250109 21:10:42.114356 22552 raft_consensus.cc:2798] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:42.114809 22552 raft_consensus.cc:695] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:42.115549 22552 consensus_queue.cc:237] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:42.125329 21066 catalog_manager.cc:5526] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 2 to 3, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:42.194056 22562 ts_tablet_manager.cc:927] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:42.199640 22562 tablet_copy_client.cc:323] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:42.201049 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 65dabcea5fff4017b727f2fcdee56246 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:42.201570 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 65dabcea5fff4017b727f2fcdee56246 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-65dabcea5fff4017b727f2fcdee56246
I20250109 21:10:42.208096 21334 tablet_copy_source_session.cc:215] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:42.210526 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 65dabcea5fff4017b727f2fcdee56246. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:42.223392 22562 tablet_copy_client.cc:806] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:42.223915 22562 tablet_copy_client.cc:670] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:42.227129 22562 tablet_copy_client.cc:538] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:42.235759 22562 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:42.258445 22562 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:42.259202 22562 tablet_bootstrap.cc:492] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:42.259732 22562 ts_tablet_manager.cc:1397] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.024s user 0.010s sys 0.010s
I20250109 21:10:42.261842 22562 raft_consensus.cc:357] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:42.262538 22562 raft_consensus.cc:738] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:42.263147 22562 consensus_queue.cc:260] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:42.265923 22562 ts_tablet_manager.cc:1428] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.003s sys 0.002s
I20250109 21:10:42.268187 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-65dabcea5fff4017b727f2fcdee56246 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:42.268674 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-65dabcea5fff4017b727f2fcdee56246 on tablet 65dabcea5fff4017b727f2fcdee56246 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:42.443650 22562 ts_tablet_manager.cc:927] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:42.445209 22562 tablet_copy_client.cc:323] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:42.446579 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet 7e21bd94dd8648d09b26343df6230d65 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:42.447105 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet 7e21bd94dd8648d09b26343df6230d65 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-7e21bd94dd8648d09b26343df6230d65
I20250109 21:10:42.452801 21258 tablet_copy_source_session.cc:215] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:42.455376 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7e21bd94dd8648d09b26343df6230d65. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:42.468256 22562 tablet_copy_client.cc:806] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:42.469038 22562 tablet_copy_client.cc:670] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:42.472409 22562 tablet_copy_client.cc:538] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:42.479112 22562 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:42.480414 21320 raft_consensus.cc:1270] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:42.482276 22557 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:42.499675 21881 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250109 21:10:42.501940 21166 raft_consensus.cc:1270] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:42.501682 22487 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
I20250109 21:10:42.503580 22530 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:10:42.533214 22562 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:42.534045 22562 tablet_bootstrap.cc:492] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:42.534698 22562 ts_tablet_manager.cc:1397] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.056s user 0.008s sys 0.026s
I20250109 21:10:42.542855 22562 raft_consensus.cc:357] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:42.548678 22562 raft_consensus.cc:738] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:42.550397 22562 consensus_queue.cc:260] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:42.553071 22562 ts_tablet_manager.cc:1428] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.013s user 0.003s sys 0.002s
I20250109 21:10:42.554817 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-7e21bd94dd8648d09b26343df6230d65 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:42.555243 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-7e21bd94dd8648d09b26343df6230d65 on tablet 7e21bd94dd8648d09b26343df6230d65 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:42.561079 22562 ts_tablet_manager.cc:927] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:42.578889 22569 ts_tablet_manager.cc:927] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:42.582790 22562 tablet_copy_client.cc:323] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.193:33243
I20250109 21:10:42.584452 21181 tablet_copy_service.cc:140] P 1774487f18694af1a5340fc8486cff53: Received BeginTabletCopySession request for tablet b3b31fe68ef047b3b126d525dd19991d from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:47312)
I20250109 21:10:42.584962 21181 tablet_copy_service.cc:161] P 1774487f18694af1a5340fc8486cff53: Beginning new tablet copy session on tablet b3b31fe68ef047b3b126d525dd19991d from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:47312: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-b3b31fe68ef047b3b126d525dd19991d
I20250109 21:10:42.592970 21181 tablet_copy_source_session.cc:215] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:42.604887 22562 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b3b31fe68ef047b3b126d525dd19991d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:42.606415 22569 tablet_copy_client.cc:323] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:42.608305 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet e719827258244d4c9a82be8775a044f5 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:42.608857 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet e719827258244d4c9a82be8775a044f5 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-e719827258244d4c9a82be8775a044f5
I20250109 21:10:42.613783 21243 raft_consensus.cc:1270] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250109 21:10:42.622869 21258 tablet_copy_source_session.cc:215] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:42.626240 22569 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e719827258244d4c9a82be8775a044f5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:42.628746 22562 tablet_copy_client.cc:806] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:42.629338 22562 tablet_copy_client.cc:670] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:42.615782 22578 consensus_queue.cc:1035] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.014s
I20250109 21:10:42.633280 21322 raft_consensus.cc:1270] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:10:42.637622 22379 consensus_queue.cc:1035] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:42.642427 22562 tablet_copy_client.cc:538] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:42.644644 21878 raft_consensus.cc:1212] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:42.660171 21248 raft_consensus.cc:1270] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:10:42.661919 22379 consensus_queue.cc:1035] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:42.704177 22562 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:42.746089 22569 tablet_copy_client.cc:806] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:42.746670 22569 tablet_copy_client.cc:670] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:42.751284 22569 tablet_copy_client.cc:538] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:42.765657 22569 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:42.776582 22562 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:42.777426 22562 tablet_bootstrap.cc:492] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:42.778205 22562 ts_tablet_manager.cc:1397] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.074s user 0.017s sys 0.009s
I20250109 21:10:42.780261 22562 raft_consensus.cc:357] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:42.781140 22562 raft_consensus.cc:738] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:42.781647 22562 consensus_queue.cc:260] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:42.783833 22562 ts_tablet_manager.cc:1428] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20250109 21:10:42.791633 21181 tablet_copy_service.cc:342] P 1774487f18694af1a5340fc8486cff53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-b3b31fe68ef047b3b126d525dd19991d received from {username='slave'} at 127.0.0.1:47312
I20250109 21:10:42.792042 21181 tablet_copy_service.cc:434] P 1774487f18694af1a5340fc8486cff53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-b3b31fe68ef047b3b126d525dd19991d on tablet b3b31fe68ef047b3b126d525dd19991d with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:42.793792 22569 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:42.794708 22569 tablet_bootstrap.cc:492] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:42.795378 22569 ts_tablet_manager.cc:1397] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.030s user 0.026s sys 0.001s
I20250109 21:10:42.797951 22569 raft_consensus.cc:357] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:42.798799 22569 raft_consensus.cc:738] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:42.799329 22569 consensus_queue.cc:260] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:42.801584 22569 ts_tablet_manager.cc:1428] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:10:42.803865 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-e719827258244d4c9a82be8775a044f5 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:42.804256 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-e719827258244d4c9a82be8775a044f5 on tablet e719827258244d4c9a82be8775a044f5 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:42.831887 21878 raft_consensus.cc:1212] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:42.911016 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:42.954890 21166 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:42.955482 21166 raft_consensus.cc:604] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:42.957798 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:42.958382 21320 raft_consensus.cc:604] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Received request to transfer leadership to TS 1774487f18694af1a5340fc8486cff53
I20250109 21:10:42.959946 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250109 21:10:42.961305 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:42.961818 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:43.023151 22577 raft_consensus.cc:1059] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:43.025391 22577 consensus_queue.cc:237] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.033041 21878 raft_consensus.cc:1212] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:43.037570 21878 raft_consensus.cc:1270] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.038942 22578 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.043257 21248 raft_consensus.cc:1270] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.044486 21166 raft_consensus.cc:1270] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.045480 22578 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.047700 22372 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.058391 22577 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.059885 21248 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.066049 21166 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.069976 21878 raft_consensus.cc:1212] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:43.088136 21066 catalog_manager.cc:5526] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.089104 21878 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.121248 21320 consensus_queue.cc:237] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.129280 21878 raft_consensus.cc:1270] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:43.130623 22578 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:43.131547 21166 raft_consensus.cc:1270] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:43.132995 22578 consensus_queue.cc:1035] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:43.137161 22577 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.137992 21878 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.143180 21168 raft_consensus.cc:2949] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.146119 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 65dabcea5fff4017b727f2fcdee56246 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:43.155397 21068 catalog_manager.cc:5526] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.157202 22372 raft_consensus.cc:988] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:43.157676 22578 raft_consensus.cc:1076] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Signalling peer 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:43.159125 21166 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:43824
I20250109 21:10:43.159634 21166 raft_consensus.cc:491] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:43.159965 21166 raft_consensus.cc:3054] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:43.165093 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet 65dabcea5fff4017b727f2fcdee56246 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:43.166437 21166 raft_consensus.cc:513] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.168430 21166 leader_election.cc:290] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 election: Requested vote from peers 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241), 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191)
I20250109 21:10:43.171630 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:43.172314 21320 raft_consensus.cc:3049] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:43.172670 21320 raft_consensus.cc:738] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:43.173663 22595 tablet_replica.cc:331] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:43.174644 21878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f75eb10b9fad472794f2398d9f305706" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
I20250109 21:10:43.175204 21878 raft_consensus.cc:3054] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:43.174669 22595 raft_consensus.cc:2238] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:43.179603 21320 consensus_queue.cc:260] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.181340 21320 raft_consensus.cc:3054] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:43.183575 21878 raft_consensus.cc:2463] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 2.
I20250109 21:10:43.184571 21136 leader_election.cc:304] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:43.185482 22550 raft_consensus.cc:2798] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:43.185942 22550 raft_consensus.cc:695] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:43.179651 22595 raft_consensus.cc:2267] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:43.186724 22550 consensus_queue.cc:237] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.190814 22595 ts_tablet_manager.cc:1905] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:43.197225 21320 raft_consensus.cc:2463] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 2.
I20250109 21:10:43.206446 22595 ts_tablet_manager.cc:1918] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:43.206828 22595 log.cc:1198] T 65dabcea5fff4017b727f2fcdee56246 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/65dabcea5fff4017b727f2fcdee56246
I20250109 21:10:43.210896 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet 65dabcea5fff4017b727f2fcdee56246 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:43.216285 21069 catalog_manager.cc:5526] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 1 to 2, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:43.223434 22552 raft_consensus.cc:988] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:43.223950 22552 raft_consensus.cc:1076] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:43.225446 21320 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:43.225960 21320 raft_consensus.cc:491] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:43.226284 21320 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:43.232302 21320 raft_consensus.cc:513] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:43.233721 22560 raft_consensus.cc:1059] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:43.234647 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:43.235574 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:43.235772 21320 leader_election.cc:290] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:43.236078 21246 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:43.236151 22560 consensus_queue.cc:237] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.235261 21168 raft_consensus.cc:3049] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:43.243309 21168 raft_consensus.cc:738] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:43.243595 21322 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.243824 21166 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.244936 22560 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.244052 21168 consensus_queue.cc:260] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:43.245926 22530 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.246359 21168 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:43.253531 21878 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.255178 22560 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.264709 22530 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.269263 21246 raft_consensus.cc:2463] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:43.273836 21288 leader_election.cc:304] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:43.275046 22578 raft_consensus.cc:2798] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:43.275843 22578 raft_consensus.cc:695] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:43.276255 21168 raft_consensus.cc:2463] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:43.277176 22578 consensus_queue.cc:237] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:43.282143 21878 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.294178 21069 catalog_manager.cc:5526] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:43.302790 21168 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.308701 21320 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.321254 21068 catalog_manager.cc:5526] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:43.334843 21248 consensus_queue.cc:237] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
W20250109 21:10:43.335799 22557 consensus_queue.cc:1159] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "1774487f18694af1a5340fc8486cff53" responder_term: 1 status { last_received { term: 1 index: 3 } last_committed_idx: 3 last_received_current_leader { term: 1 index: 3 } }
I20250109 21:10:43.339627 21879 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:43.340739 22530 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:43.341835 21168 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:43.343253 22557 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:43.355122 22530 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.363447 21171 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.365808 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 7e21bd94dd8648d09b26343df6230d65 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:43.369446 21878 raft_consensus.cc:2949] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.388477 21068 catalog_manager.cc:5526] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 3 to 4, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.405368 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 7e21bd94dd8648d09b26343df6230d65 with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:43.406845 22604 tablet_replica.cc:331] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:43.407581 22604 raft_consensus.cc:2238] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:43.408156 22604 raft_consensus.cc:2267] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:43.410681 22604 ts_tablet_manager.cc:1905] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:43.423111 22604 ts_tablet_manager.cc:1918] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:43.423430 22604 log.cc:1198] T 7e21bd94dd8648d09b26343df6230d65 P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/7e21bd94dd8648d09b26343df6230d65
I20250109 21:10:43.424724 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 7e21bd94dd8648d09b26343df6230d65 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:43.468837 22603 raft_consensus.cc:1059] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:43.471179 22603 consensus_queue.cc:237] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.480302 21878 raft_consensus.cc:1270] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.481725 21322 raft_consensus.cc:1270] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.481710 22530 consensus_queue.cc:1035] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.483004 22557 consensus_queue.cc:1035] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.486254 21171 raft_consensus.cc:1270] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:43.488987 22557 consensus_queue.cc:1035] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.508162 21320 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.507763 22560 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.508793 21171 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.525058 21065 catalog_manager.cc:5526] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.530509 21878 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.548092 21243 consensus_queue.cc:237] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.552649 21878 raft_consensus.cc:1270] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:43.553083 21320 raft_consensus.cc:1270] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:43.554294 22530 consensus_queue.cc:1035] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:43.555480 22560 consensus_queue.cc:1035] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:43.562456 22603 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.568367 21878 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.571800 21320 raft_consensus.cc:2949] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.574668 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet e719827258244d4c9a82be8775a044f5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:43.583042 21068 catalog_manager.cc:5526] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 1 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.595208 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet e719827258244d4c9a82be8775a044f5 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:43.596999 22609 tablet_replica.cc:331] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:43.599349 22609 raft_consensus.cc:2238] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:43.600072 22609 raft_consensus.cc:2267] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:43.602865 22609 ts_tablet_manager.cc:1905] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:43.616005 22609 ts_tablet_manager.cc:1918] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:43.616364 22609 log.cc:1198] T e719827258244d4c9a82be8775a044f5 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/e719827258244d4c9a82be8775a044f5
I20250109 21:10:43.617762 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet e719827258244d4c9a82be8775a044f5 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:43.699455 21243 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:43.700502 22577 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.717157 21879 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Advancing to term 2
I20250109 21:10:43.717679 21168 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:43.719830 22372 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.738063 21879 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:43.741863 22594 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:43.769974 21316 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:43.772296 22550 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:43.775928 22594 raft_consensus.cc:1059] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:43.785292 22594 consensus_queue.cc:237] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 2, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.791930 21243 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:43.793277 22594 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:43.793767 21879 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:43.794145 21168 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:43.798130 22578 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:43.799602 22578 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:43.807624 22372 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.808646 21878 raft_consensus.cc:1270] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:43.808892 21248 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.811434 22552 consensus_queue.cc:1035] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:43.826272 21879 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.834710 21171 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.836513 21069 catalog_manager.cc:5526] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 2 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.860018 21322 consensus_queue.cc:237] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 2, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:43.876523 21878 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:43.881994 22578 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:43.884334 21171 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:43.891482 22577 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:43.896229 22577 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.900272 21878 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.901826 21168 raft_consensus.cc:2949] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:43.908987 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet b3b31fe68ef047b3b126d525dd19991d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:43.920807 21069 catalog_manager.cc:5526] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 4 to 5, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:43.934808 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet b3b31fe68ef047b3b126d525dd19991d with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:43.936506 22622 tablet_replica.cc:331] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:43.938587 22622 raft_consensus.cc:2238] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:43.939262 22622 raft_consensus.cc:2267] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:43.942529 22622 ts_tablet_manager.cc:1905] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:43.952736 22622 ts_tablet_manager.cc:1918] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250109 21:10:43.953009 22622 log.cc:1198] T b3b31fe68ef047b3b126d525dd19991d P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/b3b31fe68ef047b3b126d525dd19991d
I20250109 21:10:43.954241 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet b3b31fe68ef047b3b126d525dd19991d (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:44.003737 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:44.040736 21168 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:44.041255 21168 raft_consensus.cc:604] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:44.043331 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:44.043756 21320 raft_consensus.cc:604] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Received request to transfer leadership to TS 1774487f18694af1a5340fc8486cff53
I20250109 21:10:44.045959 21248 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7e21bd94dd8648d09b26343df6230d65"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:44.046464 21248 raft_consensus.cc:604] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:44.047381 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 3
I20250109 21:10:44.048765 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:44.049341 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:44.192157 22577 raft_consensus.cc:988] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:44.193326 22594 raft_consensus.cc:1076] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Signalling peer 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:44.196324 21168 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:43824
I20250109 21:10:44.197352 21168 raft_consensus.cc:491] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:44.197835 21168 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:44.208123 21168 raft_consensus.cc:513] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:44.209739 21168 leader_election.cc:290] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 4 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:44.210945 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:44.212219 21320 raft_consensus.cc:3049] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:10:44.212546 21320 raft_consensus.cc:738] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:44.210641 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "625c888e7e504f50aec0019c1947cce5" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:44.213155 21243 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:44.214077 21320 consensus_queue.cc:260] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:44.215833 21320 raft_consensus.cc:3054] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:44.219859 21243 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 4.
I20250109 21:10:44.220979 21136 leader_election.cc:304] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:44.221905 22618 raft_consensus.cc:2798] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:10:44.222376 22618 raft_consensus.cc:695] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 4 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:44.223482 22618 consensus_queue.cc:237] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:44.224117 21320 raft_consensus.cc:2463] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 4.
I20250109 21:10:44.231125 22618 raft_consensus.cc:988] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:44.231770 22621 raft_consensus.cc:1076] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:44.233275 21320 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:44.233690 21320 raft_consensus.cc:491] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:44.234077 21320 raft_consensus.cc:3054] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:44.239234 21065 catalog_manager.cc:5526] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 3 to 4, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 4 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:44.251693 21320 raft_consensus.cc:513] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:44.254436 21320 leader_election.cc:290] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243)
I20250109 21:10:44.255843 21168 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:44.256196 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "261b93a35aef4c86b6bfb6648305855d" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:44.256494 21168 raft_consensus.cc:3049] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:44.256860 21168 raft_consensus.cc:738] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:44.256990 21243 raft_consensus.cc:3054] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:44.257911 21168 consensus_queue.cc:260] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:44.259761 21168 raft_consensus.cc:3054] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:44.265872 21243 raft_consensus.cc:2463] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:44.266784 21288 leader_election.cc:304] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:44.268798 21168 raft_consensus.cc:2463] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 2.
I20250109 21:10:44.269066 22577 raft_consensus.cc:2798] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:44.269694 22577 raft_consensus.cc:695] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:44.271659 22577 consensus_queue.cc:237] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } }
I20250109 21:10:44.283597 21065 catalog_manager.cc:5526] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 1 to 2, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:44.376350 22560 raft_consensus.cc:988] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:44.377048 22603 raft_consensus.cc:1076] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:44.378821 21881 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7e21bd94dd8648d09b26343df6230d65"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58796
I20250109 21:10:44.379379 21881 raft_consensus.cc:491] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:44.379729 21881 raft_consensus.cc:3054] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:44.386065 21881 raft_consensus.cc:513] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:44.387498 21881 leader_election.cc:290] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:44.388135 21171 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e21bd94dd8648d09b26343df6230d65" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:44.388346 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7e21bd94dd8648d09b26343df6230d65" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:44.388718 21171 raft_consensus.cc:3054] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:44.388934 21243 raft_consensus.cc:3049] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:44.389241 21243 raft_consensus.cc:738] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:44.389807 21243 consensus_queue.cc:260] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:44.390898 21243 raft_consensus.cc:3054] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:44.396894 21171 raft_consensus.cc:2463] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:44.397982 21243 raft_consensus.cc:2463] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:44.399822 21843 leader_election.cc:304] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:44.400713 22597 raft_consensus.cc:2798] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:44.401737 22597 raft_consensus.cc:695] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:44.402477 22597 consensus_queue.cc:237] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:44.410199 21065 catalog_manager.cc:5526] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:44.689069 21171 raft_consensus.cc:1270] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:44.690227 22372 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:44.704365 21243 raft_consensus.cc:1270] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:10:44.706112 22372 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:44.774348 21246 raft_consensus.cc:1270] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20250109 21:10:44.775480 22620 consensus_queue.cc:1035] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:44.784603 21320 raft_consensus.cc:1270] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20250109 21:10:44.786134 22620 consensus_queue.cc:1035] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:44.795025 21246 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:44.798274 22597 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:44.836083 21165 raft_consensus.cc:1270] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:44.837280 22579 consensus_queue.cc:1035] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:44.973603 21320 consensus_queue.cc:237] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:44.983212 21243 raft_consensus.cc:1270] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:44.984113 21165 raft_consensus.cc:1270] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:44.985525 22577 consensus_queue.cc:1035] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250109 21:10:44.985874 21288 consensus_peers.cc:487] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: b45a48f8e1e34fba9a5089b31d8966e7. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:44.987515 22577 consensus_queue.cc:1035] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:44.995783 22594 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:44.997699 21165 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:44.998340 21243 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.012451 21246 consensus_queue.cc:237] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.014225 21069 catalog_manager.cc:5526] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:45.023676 21320 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:45.025439 22603 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
W20250109 21:10:45.023844 21213 consensus_peers.cc:487] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 79be174d43c746b8bb3e3f401cef0c4f. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:45.028852 21165 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:45.033910 22603 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.002s
I20250109 21:10:45.049696 22603 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.052798 21321 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.062894 21166 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.063933 21246 consensus_queue.cc:237] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.078646 21068 catalog_manager.cc:5526] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:45.092633 21320 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:45.093118 21165 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:45.094713 22650 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:45.096321 22647 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
W20250109 21:10:45.102093 21213 consensus_peers.cc:487] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: c941548822ea4678abcf5c764a2d24a4. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:45.122329 22650 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.130987 21321 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.139492 21171 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.140497 21320 consensus_queue.cc:237] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.147267 21065 catalog_manager.cc:5526] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:45.165175 21166 raft_consensus.cc:1270] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:45.167284 21246 raft_consensus.cc:1270] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 1 index: 2. (index mismatch)
I20250109 21:10:45.167363 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:45.168669 22577 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250109 21:10:45.170321 21288 consensus_peers.cc:487] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 97a78c4d7c18498690c424edd11b94a5. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:45.171645 22594 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:10:45.184439 22577 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.185953 21166 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.190176 21246 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.2: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:45.203967 21068 catalog_manager.cc:5526] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 2, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:45.243709 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:45.244431 21320 raft_consensus.cc:604] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:45.246982 21166 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:45.247499 21166 raft_consensus.cc:604] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Received request to transfer leadership to TS 0175ef2fbd0349568ba2bf83788476ea
I20250109 21:10:45.248600 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250109 21:10:45.249976 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:45.250661 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:45.299794 22577 raft_consensus.cc:988] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:45.300251 22577 raft_consensus.cc:1076] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:45.304158 21243 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57556
I20250109 21:10:45.304663 21243 raft_consensus.cc:491] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:45.304996 21243 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:45.310971 21243 raft_consensus.cc:513] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:45.313910 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:45.314436 21320 raft_consensus.cc:3049] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:45.314726 21320 raft_consensus.cc:738] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:45.315436 21320 consensus_queue.cc:260] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:45.316427 21320 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:45.322243 21320 raft_consensus.cc:2463] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 3.
I20250109 21:10:45.323473 21214 leader_election.cc:304] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:45.324223 22560 raft_consensus.cc:2798] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:45.324600 22560 raft_consensus.cc:695] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:45.325462 22560 consensus_queue.cc:237] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:45.329859 22634 raft_consensus.cc:988] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53: : Instructing follower 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:45.330348 22634 raft_consensus.cc:1076] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Signalling peer 0175ef2fbd0349568ba2bf83788476ea to start an election
I20250109 21:10:45.334621 21243 leader_election.cc:290] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 3 election: Requested vote from peers 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241), 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191)
I20250109 21:10:45.335800 21881 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
I20250109 21:10:45.336802 21881 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:45.338706 21065 catalog_manager.cc:5526] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 2 to 3, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 3 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:45.342887 21881 raft_consensus.cc:2463] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 3.
I20250109 21:10:45.334793 21316 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
from {username='slave'} at 127.0.0.1:58552
I20250109 21:10:45.345113 21316 raft_consensus.cc:491] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:45.345466 21316 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:45.353325 21316 raft_consensus.cc:513] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:45.355326 21316 leader_election.cc:290] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 4 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:45.355353 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:45.355981 21166 raft_consensus.cc:3049] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:10:45.356309 21166 raft_consensus.cc:738] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:45.356125 21243 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3370e7f927b540069bc6fe3599a7f555" candidate_uuid: "0175ef2fbd0349568ba2bf83788476ea" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:45.356724 21243 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:45.356839 21166 consensus_queue.cc:260] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:45.357640 21166 raft_consensus.cc:3054] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:45.362532 21243 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 4.
I20250109 21:10:45.363833 21288 leader_election.cc:304] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:45.363926 21166 raft_consensus.cc:2463] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 0175ef2fbd0349568ba2bf83788476ea in term 4.
I20250109 21:10:45.364589 22372 raft_consensus.cc:2798] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:10:45.365000 22372 raft_consensus.cc:695] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 4 LEADER]: Becoming Leader. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:45.365592 22372 consensus_queue.cc:237] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:45.377338 21065 catalog_manager.cc:5526] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: term changed from 3 to 4, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195). New cstate: current_term: 4 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:45.549670 22660 ts_tablet_manager.cc:927] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:45.551486 22661 ts_tablet_manager.cc:927] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:45.552042 22660 tablet_copy_client.cc:323] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:45.553877 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet 79be174d43c746b8bb3e3f401cef0c4f from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:45.553962 22661 tablet_copy_client.cc:323] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:45.554445 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet 79be174d43c746b8bb3e3f401cef0c4f from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-79be174d43c746b8bb3e3f401cef0c4f
I20250109 21:10:45.555889 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet b45a48f8e1e34fba9a5089b31d8966e7 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:45.556442 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet b45a48f8e1e34fba9a5089b31d8966e7 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-b45a48f8e1e34fba9a5089b31d8966e7
I20250109 21:10:45.565495 21334 tablet_copy_source_session.cc:215] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:45.569339 22661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b45a48f8e1e34fba9a5089b31d8966e7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:45.574999 22664 ts_tablet_manager.cc:927] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:45.590591 22661 tablet_copy_client.cc:806] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:45.591459 22661 tablet_copy_client.cc:670] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:45.596575 22661 tablet_copy_client.cc:538] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:45.597055 21258 tablet_copy_source_session.cc:215] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:45.605312 22661 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:45.605504 22660 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 79be174d43c746b8bb3e3f401cef0c4f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:45.624061 22660 tablet_copy_client.cc:806] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:45.624949 22660 tablet_copy_client.cc:670] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:45.628682 22660 tablet_copy_client.cc:538] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:45.635093 22664 tablet_copy_client.cc:323] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:45.636767 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet c941548822ea4678abcf5c764a2d24a4 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:45.637288 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet c941548822ea4678abcf5c764a2d24a4 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-c941548822ea4678abcf5c764a2d24a4
I20250109 21:10:45.652485 21258 tablet_copy_source_session.cc:215] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:45.654688 22660 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:45.660931 22664 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c941548822ea4678abcf5c764a2d24a4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:45.663753 22661 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:45.664719 22661 tablet_bootstrap.cc:492] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:45.667090 22661 ts_tablet_manager.cc:1397] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.062s user 0.029s sys 0.020s
I20250109 21:10:45.670142 22661 raft_consensus.cc:357] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.671097 22661 raft_consensus.cc:738] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:45.671780 22661 consensus_queue.cc:260] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.674619 22661 ts_tablet_manager.cc:1428] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:45.682879 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-b45a48f8e1e34fba9a5089b31d8966e7 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:45.683404 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-b45a48f8e1e34fba9a5089b31d8966e7 on tablet b45a48f8e1e34fba9a5089b31d8966e7 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:45.686793 22664 tablet_copy_client.cc:806] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:45.690234 22664 tablet_copy_client.cc:670] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:45.694993 22664 tablet_copy_client.cc:538] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:45.703825 22660 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:45.704769 22660 tablet_bootstrap.cc:492] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:45.705472 22660 ts_tablet_manager.cc:1397] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.051s user 0.026s sys 0.011s
I20250109 21:10:45.706998 22664 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:45.708446 22660 raft_consensus.cc:357] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.709338 22660 raft_consensus.cc:738] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:45.709959 22660 consensus_queue.cc:260] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.715201 22660 ts_tablet_manager.cc:1428] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.009s user 0.003s sys 0.003s
I20250109 21:10:45.716918 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-79be174d43c746b8bb3e3f401cef0c4f received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:45.717291 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-79be174d43c746b8bb3e3f401cef0c4f on tablet 79be174d43c746b8bb3e3f401cef0c4f with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:45.717962 22661 ts_tablet_manager.cc:927] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:45.722863 22661 tablet_copy_client.cc:323] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:45.725458 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 97a78c4d7c18498690c424edd11b94a5 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:45.725996 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 97a78c4d7c18498690c424edd11b94a5 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-97a78c4d7c18498690c424edd11b94a5
I20250109 21:10:45.734306 21334 tablet_copy_source_session.cc:215] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:45.737593 22661 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 97a78c4d7c18498690c424edd11b94a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:45.741362 22664 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:45.742458 22664 tablet_bootstrap.cc:492] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:45.743149 22664 ts_tablet_manager.cc:1397] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.036s user 0.020s sys 0.004s
I20250109 21:10:45.745936 22664 raft_consensus.cc:357] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.746817 22664 raft_consensus.cc:738] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:45.747632 22664 consensus_queue.cc:260] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.750957 22664 ts_tablet_manager.cc:1428] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20250109 21:10:45.755340 22661 tablet_copy_client.cc:806] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:45.755899 22661 tablet_copy_client.cc:670] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:45.758220 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-c941548822ea4678abcf5c764a2d24a4 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:45.758677 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-c941548822ea4678abcf5c764a2d24a4 on tablet c941548822ea4678abcf5c764a2d24a4 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:45.777484 22661 tablet_copy_client.cc:538] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:45.787286 22661 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:45.805680 22661 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=2 overwritten=0 applied=2 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:45.806514 22661 tablet_bootstrap.cc:492] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:45.807171 22661 ts_tablet_manager.cc:1397] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.004s
I20250109 21:10:45.809914 22661 raft_consensus.cc:357] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.810896 22661 raft_consensus.cc:738] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:45.811609 22661 consensus_queue.cc:260] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 2 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:45.814415 22661 ts_tablet_manager.cc:1428] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:45.818779 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-97a78c4d7c18498690c424edd11b94a5 received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:45.819192 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-97a78c4d7c18498690c424edd11b94a5 on tablet 97a78c4d7c18498690c424edd11b94a5 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:45.834172 21322 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250109 21:10:45.835397 22647 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250109 21:10:45.848927 21878 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250109 21:10:45.851701 22650 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250109 21:10:45.865497 21166 raft_consensus.cc:1270] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:10:45.866864 22594 consensus_queue.cc:1035] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:45.903002 21246 raft_consensus.cc:1270] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:10:45.904687 22594 consensus_queue.cc:1035] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:45.953642 21878 raft_consensus.cc:1212] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250109 21:10:45.996160 21878 raft_consensus.cc:1212] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250109 21:10:46.137048 21881 raft_consensus.cc:1212] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:46.227667 21881 raft_consensus.cc:1212] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Deduplicated request from leader. Original: 1.1->[1.2-1.2] Dedup: 1.2->[]
I20250109 21:10:46.303333 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:46.346410 21241 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "abb16506c36a4e58a36455d201947d07"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:46.347047 21241 raft_consensus.cc:604] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:46.349483 21320 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d"
dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
mode: GRACEFUL
new_leader_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:54618
I20250109 21:10:46.350014 21320 raft_consensus.cc:604] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Received request to transfer leadership to TS 1774487f18694af1a5340fc8486cff53
I20250109 21:10:46.351226 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250109 21:10:46.352815 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:46.353407 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:46.359455 22372 raft_consensus.cc:988] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea: : Instructing follower 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:46.359835 22372 raft_consensus.cc:1076] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Signalling peer 1774487f18694af1a5340fc8486cff53 to start an election
I20250109 21:10:46.361210 21165 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
from {username='slave'} at 127.0.0.1:43824
I20250109 21:10:46.361702 21165 raft_consensus.cc:491] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:46.362002 21165 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:46.372967 22650 raft_consensus.cc:988] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:46.373464 22650 raft_consensus.cc:1076] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:46.374410 21165 raft_consensus.cc:513] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.374822 21881 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "abb16506c36a4e58a36455d201947d07"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58796
I20250109 21:10:46.375442 21881 raft_consensus.cc:491] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:46.375778 21881 raft_consensus.cc:3054] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:46.395467 21881 raft_consensus.cc:513] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.402315 21881 leader_election.cc:290] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:46.403368 21166 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:46.403592 21248 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "abb16506c36a4e58a36455d201947d07" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 2 candidate_status { last_received { term: 1 index: 4 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:46.404477 21165 leader_election.cc:290] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 3 election: Requested vote from peers 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241), 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191)
I20250109 21:10:46.405112 21248 raft_consensus.cc:3049] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:10:46.405086 21166 raft_consensus.cc:3054] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:46.405373 21878 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
I20250109 21:10:46.405725 21248 raft_consensus.cc:738] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:46.405966 21878 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:46.406498 21248 consensus_queue.cc:260] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.407514 21248 raft_consensus.cc:3054] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:46.413491 21248 raft_consensus.cc:2463] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:46.414990 21843 leader_election.cc:304] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:46.415714 22597 raft_consensus.cc:2798] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:46.416179 22597 raft_consensus.cc:695] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:46.416998 22597 consensus_queue.cc:237] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 1.4, Last appended by leader: 4, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.417991 21878 raft_consensus.cc:2463] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 3.
I20250109 21:10:46.419274 21136 leader_election.cc:304] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 1774487f18694af1a5340fc8486cff53, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:46.419552 21320 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b3b31fe68ef047b3b126d525dd19991d" candidate_uuid: "1774487f18694af1a5340fc8486cff53" candidate_term: 3 candidate_status { last_received { term: 2 index: 5 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:46.420306 21320 raft_consensus.cc:3049] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:10:46.420580 22618 raft_consensus.cc:2798] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:10:46.420652 21320 raft_consensus.cc:738] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 0175ef2fbd0349568ba2bf83788476ea, State: Running, Role: LEADER
I20250109 21:10:46.421101 22618 raft_consensus.cc:695] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Becoming Leader. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:46.421428 21320 consensus_queue.cc:260] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.421929 22618 consensus_queue.cc:237] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 5, Committed index: 5, Last appended: 2.5, Last appended by leader: 5, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.423907 21320 raft_consensus.cc:3054] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:10:46.423489 21166 raft_consensus.cc:2463] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 2.
I20250109 21:10:46.433970 22560 raft_consensus.cc:1059] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:46.437131 22560 consensus_queue.cc:237] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.466653 21320 raft_consensus.cc:2463] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 1774487f18694af1a5340fc8486cff53 in term 3.
I20250109 21:10:46.476044 21069 catalog_manager.cc:5526] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 1 to 2, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:46.509673 21878 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:46.512413 22685 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20250109 21:10:46.547082 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 47630.6us
I20250109 21:10:46.555554 21320 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
W20250109 21:10:46.579725 21137 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 156226us
I20250109 21:10:46.581028 22647 raft_consensus.cc:1059] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:46.588646 22647 consensus_queue.cc:237] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.591923 22685 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:46.605542 21166 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:46.606704 22684 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:46.612815 21068 catalog_manager.cc:5526] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 reported cstate change: term changed from 2 to 3, leader changed from 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) to 1774487f18694af1a5340fc8486cff53 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "1774487f18694af1a5340fc8486cff53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:46.618891 22691 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.624413 21322 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.647646 21878 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.655221 21069 catalog_manager.cc:5526] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:46.666710 21165 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.668524 22594 raft_consensus.cc:1059] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:46.671880 22594 consensus_queue.cc:237] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.694716 21322 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:46.697026 21879 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:46.698626 22691 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:46.700654 22685 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:46.722461 21165 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:46.723856 22691 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:46.730136 21246 raft_consensus.cc:1270] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:46.729801 21248 consensus_queue.cc:237] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.731557 21881 raft_consensus.cc:1270] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:46.732934 21166 raft_consensus.cc:1270] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:46.731645 22372 consensus_queue.cc:1035] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.005s
I20250109 21:10:46.737720 22372 consensus_queue.cc:1035] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:46.739435 22678 consensus_queue.cc:1035] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:46.739255 22689 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.750264 21880 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.765452 21322 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.766956 21171 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:46.786093 21879 raft_consensus.cc:1270] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:46.786586 21068 catalog_manager.cc:5526] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.789016 22689 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:46.799057 22685 consensus_queue.cc:1035] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:46.803592 21241 consensus_queue.cc:237] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.805357 22594 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.809778 21316 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:46.811919 22685 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:46.814499 21881 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.819742 21877 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.817842 22684 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.836546 21165 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.839736 22691 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.841771 21878 raft_consensus.cc:1270] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:46.851089 22647 consensus_queue.cc:1035] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:46.851493 21321 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.856491 21166 raft_consensus.cc:2949] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.877847 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet c941548822ea4678abcf5c764a2d24a4 with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:46.880867 21321 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250109 21:10:46.881794 21881 raft_consensus.cc:2949] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.860240 21068 catalog_manager.cc:5526] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 4 to 5, VOTER 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195) evicted. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.885205 22686 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.001s
W20250109 21:10:46.897081 21288 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 81422us
I20250109 21:10:46.905355 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 79be174d43c746b8bb3e3f401cef0c4f with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:46.913249 21165 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.925619 22707 raft_consensus.cc:1059] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:46.925042 21069 catalog_manager.cc:5526] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.926398 21305 tablet_service.cc:1514] Processing DeleteTablet for tablet 79be174d43c746b8bb3e3f401cef0c4f with delete_type TABLET_DATA_TOMBSTONED (TS 0175ef2fbd0349568ba2bf83788476ea not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:58526
I20250109 21:10:46.932906 21166 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:46.935082 22597 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:46.955960 22709 tablet_replica.cc:331] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:46.957015 22709 raft_consensus.cc:2238] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:46.957903 22709 raft_consensus.cc:2267] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:46.954185 22707 consensus_queue.cc:237] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 0, Current term: 1, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:46.962926 21152 tablet_service.cc:1514] Processing DeleteTablet for tablet c941548822ea4678abcf5c764a2d24a4 with delete_type TABLET_DATA_TOMBSTONED (TS 1774487f18694af1a5340fc8486cff53 not found in new config with opid_index 5) from {username='slave'} at 127.0.0.1:43816
I20250109 21:10:46.967619 21246 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.971813 21068 catalog_manager.cc:5526] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:46.977402 21878 raft_consensus.cc:1270] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Refusing update from remote peer 1774487f18694af1a5340fc8486cff53: Log matching property violated. Preceding OpId in replica: term: 2 index: 5. Preceding OpId from leader: term: 3 index: 6. (index mismatch)
I20250109 21:10:46.978794 22686 consensus_queue.cc:1035] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 6, Last known committed idx: 5, Time since last communication: 0.000s
I20250109 21:10:47.010501 22709 ts_tablet_manager.cc:1905] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:47.026535 22713 tablet_replica.cc:331] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:47.027808 22713 raft_consensus.cc:2238] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:47.028688 22713 raft_consensus.cc:2267] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:47.033525 21844 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 54464.1us
I20250109 21:10:47.068917 21322 consensus_queue.cc:237] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:47.074538 21246 raft_consensus.cc:1270] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 1 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:47.087998 21166 raft_consensus.cc:1270] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:47.089656 22372 consensus_queue.cc:1035] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:47.093637 21165 raft_consensus.cc:1270] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:47.100772 22372 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:47.103482 21246 raft_consensus.cc:1270] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:47.116218 21877 raft_consensus.cc:1270] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:47.117097 22713 ts_tablet_manager.cc:1905] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:47.125543 22720 consensus_queue.cc:1035] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:10:47.134078 21881 raft_consensus.cc:1270] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 1 index: 3. (index mismatch)
I20250109 21:10:47.156502 22594 consensus_queue.cc:1035] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:47.167186 22713 ts_tablet_manager.cc:1918] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250109 21:10:47.167716 22713 log.cc:1198] T c941548822ea4678abcf5c764a2d24a4 P 1774487f18694af1a5340fc8486cff53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/wals/c941548822ea4678abcf5c764a2d24a4
I20250109 21:10:47.170512 22372 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:47.178429 22722 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:10:47.185840 21055 catalog_manager.cc:4872] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): tablet c941548822ea4678abcf5c764a2d24a4 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:47.221038 21171 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.211838 22722 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.252601 22709 ts_tablet_manager.cc:1918] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 2.4
I20250109 21:10:47.253209 22709 log.cc:1198] T 79be174d43c746b8bb3e3f401cef0c4f P 0175ef2fbd0349568ba2bf83788476ea: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/wals/79be174d43c746b8bb3e3f401cef0c4f
I20250109 21:10:47.255103 21056 catalog_manager.cc:4872] TS 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): tablet 79be174d43c746b8bb3e3f401cef0c4f (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:47.248865 21877 raft_consensus.cc:2949] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.265215 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet b45a48f8e1e34fba9a5089b31d8966e7 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:47.265056 21065 catalog_manager.cc:5526] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.294579 22721 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.300274 21241 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.304416 21877 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.311374 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet b45a48f8e1e34fba9a5089b31d8966e7 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:47.339463 22730 tablet_replica.cc:331] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:47.341019 22730 raft_consensus.cc:2238] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:47.341960 22730 raft_consensus.cc:2267] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:47.347549 21065 catalog_manager.cc:5526] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.357939 21165 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.3: config changed from index 2 to 3, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } attrs { replace: true } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.362146 22730 ts_tablet_manager.cc:1905] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:47.385483 21321 consensus_queue.cc:237] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 1.3, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:47.395465 21165 raft_consensus.cc:1270] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:47.396843 22594 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:47.401062 21877 raft_consensus.cc:1270] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 1 index: 3. Preceding OpId from leader: term: 1 index: 4. (index mismatch)
I20250109 21:10:47.402447 22721 consensus_queue.cc:1035] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:47.405972 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:47.407994 22730 ts_tablet_manager.cc:1918] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:47.408450 22730 log.cc:1198] T b45a48f8e1e34fba9a5089b31d8966e7 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/b45a48f8e1e34fba9a5089b31d8966e7
I20250109 21:10:47.410840 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet b45a48f8e1e34fba9a5089b31d8966e7 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:47.414057 22726 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.427147 21878 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.433140 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 97a78c4d7c18498690c424edd11b94a5 with cas_config_opid_index 3: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:47.436157 21165 raft_consensus.cc:2949] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Committing config change with OpId 1.4: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.441995 21065 catalog_manager.cc:5526] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, VOTER f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) evicted. New cstate: current_term: 1 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:47.467068 21231 tablet_service.cc:1514] Processing DeleteTablet for tablet 97a78c4d7c18498690c424edd11b94a5 with delete_type TABLET_DATA_TOMBSTONED (TS f5d1eaae36f84176860e3799d49e4f53 not found in new config with opid_index 4) from {username='slave'} at 127.0.0.1:57544
I20250109 21:10:47.468111 22730 tablet_replica.cc:331] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:47.469105 22730 raft_consensus.cc:2238] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:47.469871 22730 raft_consensus.cc:2267] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:47.474346 22730 ts_tablet_manager.cc:1905] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: Deleting tablet data with delete state TABLET_DATA_TOMBSTONED
I20250109 21:10:47.500072 22730 ts_tablet_manager.cc:1918] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: tablet deleted with delete type TABLET_DATA_TOMBSTONED: last-logged OpId 1.3
I20250109 21:10:47.500474 22730 log.cc:1198] T 97a78c4d7c18498690c424edd11b94a5 P f5d1eaae36f84176860e3799d49e4f53: Deleting WAL directory at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.AddTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/wals/97a78c4d7c18498690c424edd11b94a5
I20250109 21:10:47.502122 21055 catalog_manager.cc:4872] TS f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): tablet 97a78c4d7c18498690c424edd11b94a5 (table test-workload [id=3c0bf0d71bfa41c58b58e3d28a3250f1]) successfully deleted
I20250109 21:10:47.508980 21165 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029"
dest_uuid: "1774487f18694af1a5340fc8486cff53"
mode: GRACEFUL
new_leader_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:51054
I20250109 21:10:47.509431 21165 raft_consensus.cc:604] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Received request to transfer leadership to TS f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:47.510491 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250109 21:10:47.511749 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:47.512179 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:47.811766 22635 raft_consensus.cc:988] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53: : Instructing follower f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:47.812274 22634 raft_consensus.cc:1076] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Signalling peer f5d1eaae36f84176860e3799d49e4f53 to start an election
I20250109 21:10:47.813500 21246 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
from {username='slave'} at 127.0.0.1:57552
I20250109 21:10:47.813923 21246 raft_consensus.cc:491] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:47.814157 21246 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:47.818360 21246 raft_consensus.cc:513] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:47.819692 21246 leader_election.cc:290] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 4 election: Requested vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:47.820307 21165 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "1774487f18694af1a5340fc8486cff53"
I20250109 21:10:47.820736 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4d0bc120aef54405ad4ea7aee525a029" candidate_uuid: "f5d1eaae36f84176860e3799d49e4f53" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:47.820883 21165 raft_consensus.cc:3049] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:10:47.821247 21165 raft_consensus.cc:738] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 1774487f18694af1a5340fc8486cff53, State: Running, Role: LEADER
I20250109 21:10:47.821957 21165 consensus_queue.cc:260] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:47.822441 21321 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:47.823213 21165 raft_consensus.cc:3054] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:47.829124 21321 raft_consensus.cc:2463] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 4.
I20250109 21:10:47.830056 21165 raft_consensus.cc:2463] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate f5d1eaae36f84176860e3799d49e4f53 in term 4.
I20250109 21:10:47.830135 21214 leader_election.cc:304] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, f5d1eaae36f84176860e3799d49e4f53; no voters:
I20250109 21:10:47.831012 22688 raft_consensus.cc:2798] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:10:47.831463 22688 raft_consensus.cc:695] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 4 LEADER]: Becoming Leader. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:47.832177 22688 consensus_queue.cc:237] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 3, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } }
I20250109 21:10:47.840914 21065 catalog_manager.cc:5526] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: term changed from 3 to 4, leader changed from 1774487f18694af1a5340fc8486cff53 (127.19.136.193) to f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194). New cstate: current_term: 4 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:48.323920 21165 raft_consensus.cc:1270] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:10:48.325099 22688 consensus_queue.cc:1035] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:48.334350 21316 raft_consensus.cc:1270] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 4 index: 4. (index mismatch)
I20250109 21:10:48.335503 22688 consensus_queue.cc:1035] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:48.504380 21246 consensus_queue.cc:237] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:48.509379 21316 raft_consensus.cc:1270] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
W20250109 21:10:48.509708 21213 consensus_peers.cc:487] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: bba485e8800045ec8e33924e02890beb. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:48.510622 22688 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:48.511147 21171 raft_consensus.cc:1270] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:48.512193 22685 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:48.518235 22685 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.519062 21316 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.520514 21171 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.532498 21246 consensus_queue.cc:237] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:48.537935 21068 catalog_manager.cc:5526] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.548944 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:48.567327 21316 raft_consensus.cc:1270] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:10:48.568778 21171 raft_consensus.cc:1270] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:10:48.568674 22742 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
W20250109 21:10:48.571027 21213 consensus_peers.cc:487] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: f8fab7dbf6344706915ff7ec21cc5430. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:48.571761 22688 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:48.579118 22688 raft_consensus.cc:2949] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.588447 21316 raft_consensus.cc:2949] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.593587 21246 consensus_queue.cc:237] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 3.3, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:48.609760 21171 raft_consensus.cc:2949] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.610435 21066 catalog_manager.cc:5526] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 4, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 3 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:48.620978 21316 raft_consensus.cc:1270] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
W20250109 21:10:48.623154 21213 consensus_peers.cc:487] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 3991f36cf1024599a42cd83ea8bbd158. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:48.624038 22688 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:48.627434 21171 raft_consensus.cc:1270] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:10:48.630528 22685 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:48.642416 21241 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552"
dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
mode: GRACEFUL
new_leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:10:48.643067 21241 raft_consensus.cc:604] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Received request to transfer leadership to TS 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:48.645821 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250109 21:10:48.648005 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:48.648561 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:48.655843 22685 raft_consensus.cc:2949] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.660138 21316 raft_consensus.cc:2949] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.664799 22742 raft_consensus.cc:988] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: : Instructing follower 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:48.665288 22742 raft_consensus.cc:1076] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Signalling peer 59024e0e40b941ad9d0df6bb6bc4f4f5 to start an election
I20250109 21:10:48.666834 21878 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552"
dest_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5"
from {username='slave'} at 127.0.0.1:58796
I20250109 21:10:48.667384 21878 raft_consensus.cc:491] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:10:48.667662 21878 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:48.674386 21878 raft_consensus.cc:513] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:48.676652 21878 leader_election.cc:290] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 4 election: Requested vote from peers f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:48.678754 21321 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "0175ef2fbd0349568ba2bf83788476ea"
I20250109 21:10:48.679383 21321 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:48.683759 21322 consensus_queue.cc:237] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:48.684996 21246 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c81c3f41770456c82eac4f8e6aa7552" candidate_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" candidate_term: 4 candidate_status { last_received { term: 3 index: 6 } } ignore_live_leader: true dest_uuid: "f5d1eaae36f84176860e3799d49e4f53"
I20250109 21:10:48.685573 21246 raft_consensus.cc:3049] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:10:48.685830 21246 raft_consensus.cc:738] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: f5d1eaae36f84176860e3799d49e4f53, State: Running, Role: LEADER
I20250109 21:10:48.687865 21246 consensus_queue.cc:260] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:48.689872 21246 raft_consensus.cc:3054] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:10:48.684217 21068 catalog_manager.cc:5526] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index -1 to 4, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 3 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:48.696677 21171 raft_consensus.cc:2949] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Committing config change with OpId 3.4: config changed from index -1 to 4, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
W20250109 21:10:48.701557 21288 consensus_peers.cc:487] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea -> Peer 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196:33191): Couldn't send request to peer 59024e0e40b941ad9d0df6bb6bc4f4f5. Error code: TABLET_NOT_FOUND (6). Status: Not found: Tablet not found: 261b93a35aef4c86b6bfb6648305855d. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:48.707607 21321 raft_consensus.cc:2463] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 4.
I20250109 21:10:48.710042 21844 leader_election.cc:304] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 0175ef2fbd0349568ba2bf83788476ea, 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters:
I20250109 21:10:48.710862 22733 raft_consensus.cc:2798] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:10:48.711369 22733 raft_consensus.cc:695] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 LEADER]: Becoming Leader. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Running, Role: LEADER
I20250109 21:10:48.712121 22733 consensus_queue.cc:237] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 6, Committed index: 6, Last appended: 3.6, Last appended by leader: 6, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:48.719929 21246 raft_consensus.cc:2463] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 59024e0e40b941ad9d0df6bb6bc4f4f5 in term 4.
I20250109 21:10:48.720319 21171 raft_consensus.cc:1270] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:48.721884 22721 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:48.726016 21066 catalog_manager.cc:5526] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: term changed from 3 to 4, leader changed from f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194) to 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196). New cstate: current_term: 4 leader_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:48.736801 21246 raft_consensus.cc:1270] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:10:48.739594 22726 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:10:48.759959 22721 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.762348 21241 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.763661 21171 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Committing config change with OpId 2.3: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New config: { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.777065 21068 catalog_manager.cc:5526] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 reported cstate change: config changed from index -1 to 3, NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) added. New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } } }
I20250109 21:10:48.889643 22760 ts_tablet_manager.cc:927] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:48.891155 22760 tablet_copy_client.cc:323] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:48.892418 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet bba485e8800045ec8e33924e02890beb from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:48.892908 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet bba485e8800045ec8e33924e02890beb from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-bba485e8800045ec8e33924e02890beb
I20250109 21:10:48.900447 21258 tablet_copy_source_session.cc:215] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:48.903587 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet bba485e8800045ec8e33924e02890beb. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:48.918234 22760 tablet_copy_client.cc:806] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:48.918779 22760 tablet_copy_client.cc:670] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:48.922633 22760 tablet_copy_client.cc:538] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:48.931378 22760 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:48.949946 22760 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:48.950815 22760 tablet_bootstrap.cc:492] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:48.951401 22760 ts_tablet_manager.cc:1397] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.004s
I20250109 21:10:48.953928 22760 raft_consensus.cc:357] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:48.954838 22760 raft_consensus.cc:738] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:48.955420 22760 consensus_queue.cc:260] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:48.957949 22760 ts_tablet_manager.cc:1428] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20250109 21:10:48.959899 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-bba485e8800045ec8e33924e02890beb received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:48.960251 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-bba485e8800045ec8e33924e02890beb on tablet bba485e8800045ec8e33924e02890beb with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:49.116045 21321 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20250109 21:10:49.117372 22715 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20250109 21:10:49.128150 21241 raft_consensus.cc:1270] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Refusing update from remote peer 59024e0e40b941ad9d0df6bb6bc4f4f5: Log matching property violated. Preceding OpId in replica: term: 3 index: 6. Preceding OpId from leader: term: 4 index: 7. (index mismatch)
I20250109 21:10:49.132234 22760 ts_tablet_manager.cc:927] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:49.135228 22715 consensus_queue.cc:1035] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 7, Last known committed idx: 6, Time since last communication: 0.000s
I20250109 21:10:49.136515 22760 tablet_copy_client.cc:323] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.195:46241
I20250109 21:10:49.138309 21334 tablet_copy_service.cc:140] P 0175ef2fbd0349568ba2bf83788476ea: Received BeginTabletCopySession request for tablet 261b93a35aef4c86b6bfb6648305855d from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:57944)
I20250109 21:10:49.138957 21334 tablet_copy_service.cc:161] P 0175ef2fbd0349568ba2bf83788476ea: Beginning new tablet copy session on tablet 261b93a35aef4c86b6bfb6648305855d from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:57944: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-261b93a35aef4c86b6bfb6648305855d
I20250109 21:10:49.151221 22769 ts_tablet_manager.cc:927] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:49.154886 21334 tablet_copy_source_session.cc:215] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:49.158051 22760 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 261b93a35aef4c86b6bfb6648305855d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:49.185232 22767 ts_tablet_manager.cc:927] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Initiating tablet copy from peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:49.189579 22769 tablet_copy_client.cc:323] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:49.196199 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet f8fab7dbf6344706915ff7ec21cc5430 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:49.196722 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet f8fab7dbf6344706915ff7ec21cc5430 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-f8fab7dbf6344706915ff7ec21cc5430
I20250109 21:10:49.206957 21258 tablet_copy_source_session.cc:215] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:49.209281 22760 tablet_copy_client.cc:806] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:49.209877 22760 tablet_copy_client.cc:670] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:49.209830 22767 tablet_copy_client.cc:323] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Beginning tablet copy session from remote peer at address 127.19.136.194:44109
I20250109 21:10:49.212419 22769 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f8fab7dbf6344706915ff7ec21cc5430. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:49.213207 22760 tablet_copy_client.cc:538] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:49.218400 21258 tablet_copy_service.cc:140] P f5d1eaae36f84176860e3799d49e4f53: Received BeginTabletCopySession request for tablet 3991f36cf1024599a42cd83ea8bbd158 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 ({username='slave'} at 127.0.0.1:51592)
I20250109 21:10:49.218974 21258 tablet_copy_service.cc:161] P f5d1eaae36f84176860e3799d49e4f53: Beginning new tablet copy session on tablet 3991f36cf1024599a42cd83ea8bbd158 from peer 59024e0e40b941ad9d0df6bb6bc4f4f5 at {username='slave'} at 127.0.0.1:51592: session id = 59024e0e40b941ad9d0df6bb6bc4f4f5-3991f36cf1024599a42cd83ea8bbd158
I20250109 21:10:49.226119 21258 tablet_copy_source_session.cc:215] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: Tablet Copy: opened 0 blocks and 1 log segments
I20250109 21:10:49.229755 22769 tablet_copy_client.cc:806] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:49.246132 22769 tablet_copy_client.cc:670] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:49.248153 22767 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3991f36cf1024599a42cd83ea8bbd158. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:49.250020 22760 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:49.251303 22769 tablet_copy_client.cc:538] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:49.263864 22769 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:49.269312 22767 tablet_copy_client.cc:806] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 0 data blocks...
I20250109 21:10:49.270053 22767 tablet_copy_client.cc:670] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Starting download of 1 WAL segments...
I20250109 21:10:49.285486 22760 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=3 overwritten=0 applied=3 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:49.286895 22760 tablet_bootstrap.cc:492] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:49.287562 22760 ts_tablet_manager.cc:1397] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.038s user 0.019s sys 0.008s
I20250109 21:10:49.291334 22760 raft_consensus.cc:357] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:49.293215 22760 raft_consensus.cc:738] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:49.293818 22760 consensus_queue.cc:260] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 3 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:49.296196 22760 ts_tablet_manager.cc:1428] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250109 21:10:49.298931 21334 tablet_copy_service.cc:342] P 0175ef2fbd0349568ba2bf83788476ea: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-261b93a35aef4c86b6bfb6648305855d received from {username='slave'} at 127.0.0.1:57944
I20250109 21:10:49.299311 21334 tablet_copy_service.cc:434] P 0175ef2fbd0349568ba2bf83788476ea: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-261b93a35aef4c86b6bfb6648305855d on tablet 261b93a35aef4c86b6bfb6648305855d with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:49.308329 22767 tablet_copy_client.cc:538] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: tablet copy: Tablet Copy complete. Replacing tablet superblock.
I20250109 21:10:49.325663 22767 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap starting.
I20250109 21:10:49.328339 22769 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:49.329226 22769 tablet_bootstrap.cc:492] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:49.329849 22769 ts_tablet_manager.cc:1397] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.066s user 0.030s sys 0.031s
I20250109 21:10:49.332751 22769 raft_consensus.cc:357] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:49.333745 22769 raft_consensus.cc:738] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:49.334359 22769 consensus_queue.cc:260] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:49.336726 22769 ts_tablet_manager.cc:1428] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20250109 21:10:49.338236 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-f8fab7dbf6344706915ff7ec21cc5430 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:49.338620 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-f8fab7dbf6344706915ff7ec21cc5430 on tablet f8fab7dbf6344706915ff7ec21cc5430 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:49.356666 22767 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap replayed 1/1 log segments. Stats: ops{read=4 overwritten=0 applied=4 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:10:49.357542 22767 tablet_bootstrap.cc:492] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Bootstrap complete.
I20250109 21:10:49.358212 22767 ts_tablet_manager.cc:1397] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent bootstrapping tablet: real 0.033s user 0.019s sys 0.005s
I20250109 21:10:49.360960 22767 raft_consensus.cc:357] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:49.361621 22767 raft_consensus.cc:738] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Becoming Follower/Learner. State: Replica: 59024e0e40b941ad9d0df6bb6bc4f4f5, State: Initialized, Role: LEARNER
I20250109 21:10:49.362217 22767 consensus_queue.cc:260] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 4, Last appended: 3.4, Last appended by leader: 4, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: NON_VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: true } }
I20250109 21:10:49.364573 22767 ts_tablet_manager.cc:1428] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250109 21:10:49.366586 21258 tablet_copy_service.cc:342] P f5d1eaae36f84176860e3799d49e4f53: Request end of tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-3991f36cf1024599a42cd83ea8bbd158 received from {username='slave'} at 127.0.0.1:51592
I20250109 21:10:49.367004 21258 tablet_copy_service.cc:434] P f5d1eaae36f84176860e3799d49e4f53: ending tablet copy session 59024e0e40b941ad9d0df6bb6bc4f4f5-3991f36cf1024599a42cd83ea8bbd158 on tablet 3991f36cf1024599a42cd83ea8bbd158 with peer 59024e0e40b941ad9d0df6bb6bc4f4f5
I20250109 21:10:49.460057 21878 raft_consensus.cc:1212] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250109 21:10:49.521992 21878 raft_consensus.cc:1212] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Deduplicated request from leader. Original: 2.2->[2.3-2.3] Dedup: 2.3->[]
I20250109 21:10:49.587014 21878 raft_consensus.cc:1212] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20250109 21:10:49.743912 21878 raft_consensus.cc:1212] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Deduplicated request from leader. Original: 3.3->[3.4-3.4] Dedup: 3.4->[]
I20250109 21:10:49.764245 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:49.809145 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:10:49.810731 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:10:49.811317 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:49.854521 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:10:49.898550 20003 tablet_server.cc:178] TabletServer@127.19.136.193:0 shutting down...
I20250109 21:10:49.918857 22721 raft_consensus.cc:1059] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
W20250109 21:10:49.919068 21843 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250109 21:10:49.921322 22721 consensus_queue.cc:237] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
W20250109 21:10:49.941395 21843 consensus_peers.cc:487] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:49.944128 21843 consensus_peers.cc:487] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:49.953397 21213 consensus_peers.cc:487] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:49.954041 21878 raft_consensus.cc:1270] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:49.956389 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:10:49.958384 22721 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:49.959432 20003 tablet_replica.cc:331] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.960304 20003 raft_consensus.cc:2238] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:49.960793 22742 raft_consensus.cc:1059] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
W20250109 21:10:49.960879 21288 consensus_peers.cc:487] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:49.961030 20003 raft_consensus.cc:2267] T ec98ab18b5ba44949aeef1a8a519bb67 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.963702 20003 tablet_replica.cc:331] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.964553 20003 raft_consensus.cc:2238] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:49.964902 21241 raft_consensus.cc:1270] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:49.965512 20003 raft_consensus.cc:2267] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.967787 20003 tablet_replica.cc:331] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.968757 20003 raft_consensus.cc:2238] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:49.968638 22721 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:49.969332 20003 raft_consensus.cc:2267] T 897320ddfb174b3c9c5751844ec65430 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.971782 20003 tablet_replica.cc:331] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.971143 22742 consensus_queue.cc:237] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 1, Current term: 2, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:49.972380 20003 raft_consensus.cc:2238] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
W20250109 21:10:49.967730 21213 consensus_peers.cc:487] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:49.973522 20003 raft_consensus.cc:2267] T 4a96090bb1b54bf1b35f150050e71ee7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:49.975145 21213 consensus_peers.cc:487] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:49.976058 20003 tablet_replica.cc:331] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.976958 20003 raft_consensus.cc:2238] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:49.977507 20003 raft_consensus.cc:2267] T abb16506c36a4e58a36455d201947d07 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.979844 20003 tablet_replica.cc:331] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.980710 20003 raft_consensus.cc:2238] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250109 21:10:49.980789 21288 consensus_peers.cc:487] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:49.981525 20003 raft_consensus.cc:2267] T b45a48f8e1e34fba9a5089b31d8966e7 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.983753 20003 tablet_replica.cc:331] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.984556 20003 raft_consensus.cc:2238] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:49.985117 20003 raft_consensus.cc:2267] T 2f76b5c3db5e4c1885ce16d810372999 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.987418 21878 raft_consensus.cc:1270] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:49.987567 20003 tablet_replica.cc:331] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.988497 20003 raft_consensus.cc:2238] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:49.989003 20003 raft_consensus.cc:2267] T f8fab7dbf6344706915ff7ec21cc5430 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.988704 22726 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:49.991374 20003 tablet_replica.cc:331] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.992163 20003 raft_consensus.cc:2238] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:49.993084 20003 raft_consensus.cc:2267] T f8d059ec48cb46dfac04405794b984ee P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.995653 20003 tablet_replica.cc:331] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.996459 20003 raft_consensus.cc:2238] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
W20250109 21:10:49.996805 21213 consensus_peers.cc:487] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:49.997010 20003 raft_consensus.cc:2267] T 909c8965e81d4f84a75ef2fd61bcbe72 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:49.998184 22781 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:10:49.998855 20003 tablet_replica.cc:331] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:49.999569 20003 raft_consensus.cc:2238] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.000389 20003 raft_consensus.cc:2267] T 73f91268c8384e79a83979ffd1c00d99 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.002210 20003 tablet_replica.cc:331] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.002801 20003 raft_consensus.cc:2238] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
W20250109 21:10:50.000663 21214 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:46241, user_credentials={real_user=slave}} blocked reactor thread for 57795.5us
I20250109 21:10:50.001885 21877 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.005137 21316 raft_consensus.cc:1270] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 2 index: 4. (index mismatch)
I20250109 21:10:50.005244 20003 raft_consensus.cc:2267] T b920d950f0d3444d9fff00a1bad09dc6 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.007704 20003 tablet_replica.cc:331] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.008529 20003 raft_consensus.cc:2238] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.008204 21241 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.009279 20003 raft_consensus.cc:2267] T 7e21bd94dd8648d09b26343df6230d65 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.009316 21213 consensus_peers.cc:487] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.011849 20003 tablet_replica.cc:331] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.012753 20003 raft_consensus.cc:2238] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.013450 20003 raft_consensus.cc:2267] T 44dc7037c0cc4926b2e36fab2a05a11a P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.015906 20003 tablet_replica.cc:331] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.016664 20003 raft_consensus.cc:2238] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
W20250109 21:10:50.016811 21843 consensus_peers.cc:487] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.017290 20003 raft_consensus.cc:2267] T 8b90fd0d512143d7ba14c703e675aeaf P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.019883 20003 tablet_replica.cc:331] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.020685 20003 raft_consensus.cc:2238] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.021276 20003 raft_consensus.cc:2267] T 3991f36cf1024599a42cd83ea8bbd158 P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.023530 20003 tablet_replica.cc:331] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.024411 20003 raft_consensus.cc:2238] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.025125 20003 raft_consensus.cc:2267] T 4d0bc120aef54405ad4ea7aee525a029 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.024691 21843 consensus_peers.cc:487] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.028223 20003 tablet_replica.cc:331] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.029330 20003 raft_consensus.cc:2238] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.030714 20003 raft_consensus.cc:2267] T 9fa9778f2eb54207aea2f47f9037b443 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.034026 20003 tablet_replica.cc:331] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
W20250109 21:10:50.034416 21213 consensus_peers.cc:487] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.035836 20003 raft_consensus.cc:2238] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.035578 21065 catalog_manager.cc:5526] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.036521 20003 raft_consensus.cc:2267] T 65dabcea5fff4017b727f2fcdee56246 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.039001 20003 tablet_replica.cc:331] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.040678 20003 raft_consensus.cc:2238] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.041673 20003 raft_consensus.cc:2267] T c404ac7e616f4de9b6df5a2d9259a4b6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.042665 21288 consensus_peers.cc:487] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.043988 20003 tablet_replica.cc:331] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.044800 20003 raft_consensus.cc:2238] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.045714 20003 raft_consensus.cc:2267] T 625c888e7e504f50aec0019c1947cce5 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.048288 20003 tablet_replica.cc:331] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.049042 20003 raft_consensus.cc:2238] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.049539 20003 raft_consensus.cc:2267] T 41937a55ec6c4990b362365d82685977 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.050371 22688 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:10:50.052037 20003 tablet_replica.cc:331] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.052894 20003 raft_consensus.cc:2238] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.053315 20003 raft_consensus.cc:2267] T 3370e7f927b540069bc6fe3599a7f555 P 1774487f18694af1a5340fc8486cff53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.055437 20003 tablet_replica.cc:331] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.056187 20003 raft_consensus.cc:2238] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.057344 20003 raft_consensus.cc:2267] T b3b31fe68ef047b3b126d525dd19991d P 1774487f18694af1a5340fc8486cff53 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.059756 21213 consensus_peers.cc:487] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.060330 20003 tablet_replica.cc:331] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.061216 20003 raft_consensus.cc:2238] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.062291 20003 raft_consensus.cc:2267] T 703480173d7142d0b22a2ec903e1707d P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.065722 20003 tablet_replica.cc:331] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
W20250109 21:10:50.067505 21288 consensus_peers.cc:487] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.068917 20003 raft_consensus.cc:2238] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.069839 20003 raft_consensus.cc:2267] T 800dbae8cc64427c8e80cc1ac7b42769 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.075778 20003 tablet_replica.cc:331] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.076524 20003 raft_consensus.cc:2238] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.077569 20003 raft_consensus.cc:2267] T f75eb10b9fad472794f2398d9f305706 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.079897 20003 tablet_replica.cc:331] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.080680 20003 raft_consensus.cc:2238] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.081225 20003 raft_consensus.cc:2267] T b4695aea7c274b7e830e07c2fdbb1dc6 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.083483 20003 tablet_replica.cc:331] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.084275 20003 raft_consensus.cc:2238] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.084872 20003 raft_consensus.cc:2267] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.087385 20003 tablet_replica.cc:331] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.087510 21322 consensus_queue.cc:237] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:50.091945 22781 raft_consensus.cc:1059] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:50.092517 20003 raft_consensus.cc:2238] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.093508 20003 raft_consensus.cc:2267] T 6f7c70db395b4c95bdd3a519fbff09f1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.095978 20003 tablet_replica.cc:331] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
W20250109 21:10:50.097692 21843 consensus_peers.cc:487] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.098258 21288 consensus_peers.cc:487] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.099522 21878 raft_consensus.cc:1270] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:50.100085 21241 raft_consensus.cc:1270] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Refusing update from remote peer 0175ef2fbd0349568ba2bf83788476ea: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:50.100657 20003 raft_consensus.cc:2238] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.100996 22786 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:10:50.101452 20003 raft_consensus.cc:2267] T 5bb0a4ab14fe49cd9d565ffe64396929 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.102195 22721 consensus_queue.cc:1035] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [LEADER]: Connected to new peer: Peer: permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:50.103801 20003 tablet_replica.cc:331] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.104733 20003 raft_consensus.cc:2238] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.105226 20003 raft_consensus.cc:2267] T 16dee0cc12b842ec877d167505529061 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.106503 22688 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.107687 20003 tablet_replica.cc:331] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.108525 20003 raft_consensus.cc:2238] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.109165 20003 raft_consensus.cc:2267] T bba485e8800045ec8e33924e02890beb P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.110239 22726 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.111339 20003 tablet_replica.cc:331] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.112159 20003 raft_consensus.cc:2238] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.112694 20003 raft_consensus.cc:2267] T fc2136d77ff941c8aee442e2c39c95bb P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.112039 21877 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.115082 20003 tablet_replica.cc:331] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.115841 20003 raft_consensus.cc:2238] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
W20250109 21:10:50.116143 21843 consensus_peers.cc:487] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.121130 21213 consensus_peers.cc:487] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.094329 22781 consensus_queue.cc:237] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:50.135174 20003 raft_consensus.cc:2267] T 79be174d43c746b8bb3e3f401cef0c4f P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.137730 20003 tablet_replica.cc:331] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.126348 21322 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.138582 20003 raft_consensus.cc:2238] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.139238 20003 raft_consensus.cc:2267] T a619c9914d0d497ab180faa27e65a541 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.138988 21881 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.4: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.141741 20003 tablet_replica.cc:331] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.142525 20003 raft_consensus.cc:2238] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.143280 20003 raft_consensus.cc:2267] T f660a562716e4048a180570218fae1d4 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.145771 20003 tablet_replica.cc:331] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.144897 21246 raft_consensus.cc:2949] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.146585 20003 raft_consensus.cc:2238] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.147590 20003 raft_consensus.cc:2267] T 4271f4a728084e65b74f13aa9fa0c6c0 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.150005 21288 consensus_peers.cc:487] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.150420 20003 tablet_replica.cc:331] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.151160 20003 raft_consensus.cc:2238] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.151672 20003 raft_consensus.cc:2267] T 61283e0a72e04a589880431a717f04f3 P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.153956 22685 raft_consensus.cc:1059] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53: attempting to promote NON_VOTER 59024e0e40b941ad9d0df6bb6bc4f4f5 to VOTER
I20250109 21:10:50.154120 20003 tablet_replica.cc:331] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.155071 20003 raft_consensus.cc:2238] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.155611 20003 raft_consensus.cc:2267] T 261b93a35aef4c86b6bfb6648305855d P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.157866 20003 tablet_replica.cc:331] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.157186 22685 consensus_queue.cc:237] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 3.4, Last appended by leader: 2, Current term: 3, Majority size: 3, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:50.158579 20003 raft_consensus.cc:2238] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.159495 20003 raft_consensus.cc:2267] T 2963062e448e46b3b27c83dd6c77b956 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.161909 20003 tablet_replica.cc:331] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.162549 20003 raft_consensus.cc:2238] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.163115 20003 raft_consensus.cc:2267] T c77aca60924f40f68ecc7531984ef0cc P 1774487f18694af1a5340fc8486cff53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.166008 20003 tablet_replica.cc:331] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.166597 20003 raft_consensus.cc:2238] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.167135 20003 raft_consensus.cc:2267] T d399e14db94b4089b4e14d1212dee628 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.169486 20003 tablet_replica.cc:331] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.170150 20003 raft_consensus.cc:2238] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.170673 20003 raft_consensus.cc:2267] T 97a78c4d7c18498690c424edd11b94a5 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.172977 20003 tablet_replica.cc:331] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.172516 21066 catalog_manager.cc:5526] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea reported cstate change: config changed from index 3 to 4, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } attrs { replace: true } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.173702 20003 raft_consensus.cc:2238] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.174731 20003 raft_consensus.cc:2267] T 8bfae02cdbdc49daa617467659ffaed6 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.177181 20003 tablet_replica.cc:331] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53: stopping tablet replica
I20250109 21:10:50.177881 20003 raft_consensus.cc:2238] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.162358 21068 catalog_manager.cc:5526] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 2 leader_uuid: "0175ef2fbd0349568ba2bf83788476ea" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.178642 20003 raft_consensus.cc:2267] T 35869458d4934257a5392c4158bc4cd1 P 1774487f18694af1a5340fc8486cff53 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.195359 21288 consensus_peers.cc:487] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.205257 21288 consensus_peers.cc:487] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.213961 21056 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet 261b93a35aef4c86b6bfb6648305855d with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:50.222729 21316 raft_consensus.cc:1270] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250109 21:10:50.224562 22742 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
W20250109 21:10:50.233678 21213 consensus_peers.cc:487] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.235312 21881 raft_consensus.cc:1270] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
W20250109 21:10:50.236238 21055 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.DeleteTablet -> {remote=127.19.136.193:33243, user_credentials={real_user=slave}} blocked reactor thread for 46208.2us
I20250109 21:10:50.238164 22685 consensus_queue.cc:1035] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250109 21:10:50.239231 21055 catalog_manager.cc:4615] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 261b93a35aef4c86b6bfb6648305855d: Remote error: Service unavailable: service kudu.tserver.TabletServerAdminService not registered on TabletServer
I20250109 21:10:50.254966 22742 raft_consensus.cc:2949] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.262037 21322 raft_consensus.cc:1270] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250109 21:10:50.264626 21881 raft_consensus.cc:1270] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 LEARNER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 3 index: 4. Preceding OpId from leader: term: 3 index: 5. (index mismatch)
I20250109 21:10:50.265937 22688 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:50.269135 22688 consensus_queue.cc:1035] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
W20250109 21:10:50.277777 21843 connection.cc:700] client connection to 127.19.136.193:33243 send error: Network error: sendmsg error: Connection reset by peer (error 104)
W20250109 21:10:50.279426 21843 consensus_peers.cc:487] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: sendmsg error: Connection reset by peer (error 104). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.294325 20003 tablet_server.cc:195] TabletServer@127.19.136.193:0 shutdown complete.
W20250109 21:10:50.296078 21288 consensus_peers.cc:487] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.303560 21213 consensus_peers.cc:487] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.304090 21213 consensus_peers.cc:487] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.317767 21316 raft_consensus.cc:2949] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
W20250109 21:10:50.337935 21288 consensus_peers.cc:487] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.341203 21881 raft_consensus.cc:2949] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
W20250109 21:10:50.342427 21213 consensus_peers.cc:487] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.356457 21843 consensus_peers.cc:487] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.361173 21843 consensus_peers.cc:487] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.360088 22685 raft_consensus.cc:2949] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
W20250109 21:10:50.371212 21288 consensus_peers.cc:487] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea -> Peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Couldn't send request to peer 1774487f18694af1a5340fc8486cff53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.372634 21068 catalog_manager.cc:5526] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 4 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
I20250109 21:10:50.373603 21322 raft_consensus.cc:2949] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.380388 21881 raft_consensus.cc:2949] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Committing config change with OpId 3.5: config changed from index 4 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.416770 21246 consensus_queue.cc:237] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 4, Committed index: 4, Last appended: 2.4, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:50.422139 21879 raft_consensus.cc:1270] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:50.424014 22685 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.001s
I20250109 21:10:50.425961 21065 catalog_manager.cc:5526] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 reported cstate change: config changed from index 4 to 5, 59024e0e40b941ad9d0df6bb6bc4f4f5 (127.19.136.196) changed from NON_VOTER to VOTER. New cstate: current_term: 3 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } attrs { replace: true } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.446556 21322 raft_consensus.cc:1270] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Refusing update from remote peer f5d1eaae36f84176860e3799d49e4f53: Log matching property violated. Preceding OpId in replica: term: 2 index: 4. Preceding OpId from leader: term: 2 index: 5. (index mismatch)
I20250109 21:10:50.448073 22685 consensus_queue.cc:1035] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [LEADER]: Connected to new peer: Peer: permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 5, Last known committed idx: 4, Time since last communication: 0.000s
I20250109 21:10:50.455058 22742 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.459123 21316 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.459404 21881 raft_consensus.cc:2949] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Committing config change with OpId 2.5: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New config: { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } } }
I20250109 21:10:50.466840 21055 catalog_manager.cc:5039] ChangeConfig:REMOVE_PEER RPC for tablet bba485e8800045ec8e33924e02890beb with cas_config_opid_index 4: ChangeConfig:REMOVE_PEER succeeded (attempt 1)
I20250109 21:10:50.480960 20003 tablet_server.cc:178] TabletServer@127.19.136.194:0 shutting down...
W20250109 21:10:50.487747 21843 consensus_peers.cc:487] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.490667 21068 catalog_manager.cc:5526] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 reported cstate change: config changed from index 4 to 5, VOTER 1774487f18694af1a5340fc8486cff53 (127.19.136.193) evicted. New cstate: current_term: 2 leader_uuid: "f5d1eaae36f84176860e3799d49e4f53" committed_config { opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } health_report { overall_health: HEALTHY } } }
W20250109 21:10:50.495227 21117 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20250109 21:10:50.495635 21117 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20250109 21:10:50.500136 21117 auto_rebalancer.cc:663] Could not move replica: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20250109 21:10:50.500464 21117 auto_rebalancer.cc:264] scheduled replica move failed to complete: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
W20250109 21:10:50.504190 21843 consensus_peers.cc:487] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.504832 21843 consensus_peers.cc:487] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.571081 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:10:50.572034 20003 tablet_replica.cc:331] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.572779 20003 raft_consensus.cc:2238] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.573807 20003 raft_consensus.cc:2267] T 33a9dea3cbbb40abbdf4eb26e597f857 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.575631 20003 tablet_replica.cc:331] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.576180 20003 raft_consensus.cc:2238] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.576874 20003 raft_consensus.cc:2267] T 897320ddfb174b3c9c5751844ec65430 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.578505 20003 tablet_replica.cc:331] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.579025 20003 raft_consensus.cc:2238] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.579666 20003 raft_consensus.cc:2267] T 2f76b5c3db5e4c1885ce16d810372999 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.581864 20003 tablet_replica.cc:331] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.582657 20003 raft_consensus.cc:2238] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.583473 20003 raft_consensus.cc:2267] T 8a822be40fe74d1a8c6ab5aec62bcb14 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.585151 21288 consensus_peers.cc:487] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.585640 20003 tablet_replica.cc:331] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.586226 20003 raft_consensus.cc:2238] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.586597 20003 raft_consensus.cc:2267] T 9add3f091006404a8cbf90aef76b0c5d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.588958 20003 tablet_replica.cc:331] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.589717 20003 raft_consensus.cc:2238] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.590237 20003 raft_consensus.cc:2267] T 4a96090bb1b54bf1b35f150050e71ee7 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.592417 20003 tablet_replica.cc:331] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.592952 20003 raft_consensus.cc:2238] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.593305 20003 raft_consensus.cc:2267] T abb16506c36a4e58a36455d201947d07 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.595016 20003 tablet_replica.cc:331] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.595532 20003 raft_consensus.cc:2238] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.596486 20003 raft_consensus.cc:2267] T f8fab7dbf6344706915ff7ec21cc5430 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.598224 20003 tablet_replica.cc:331] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.598723 20003 raft_consensus.cc:2238] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.599442 20003 raft_consensus.cc:2267] T e719827258244d4c9a82be8775a044f5 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.600943 20003 tablet_replica.cc:331] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.601454 20003 raft_consensus.cc:2238] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.601893 20003 raft_consensus.cc:2267] T 73f91268c8384e79a83979ffd1c00d99 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.603799 20003 tablet_replica.cc:331] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.604468 20003 raft_consensus.cc:2238] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.605054 20003 raft_consensus.cc:2267] T 7a4ca66c3087428aaf05f37bc1ba32ee P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.605769 21288 consensus_peers.cc:487] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.607203 20003 tablet_replica.cc:331] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.607894 20003 raft_consensus.cc:2238] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.608568 20003 raft_consensus.cc:2267] T f8d059ec48cb46dfac04405794b984ee P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.610450 20003 tablet_replica.cc:331] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.610989 20003 raft_consensus.cc:2238] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.611325 20003 raft_consensus.cc:2267] T c404ac7e616f4de9b6df5a2d9259a4b6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.612895 20003 tablet_replica.cc:331] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.613536 20003 raft_consensus.cc:2238] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.614219 20003 raft_consensus.cc:2267] T 41937a55ec6c4990b362365d82685977 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.616151 20003 tablet_replica.cc:331] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.616668 20003 raft_consensus.cc:2238] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.617041 20003 raft_consensus.cc:2267] T 625c888e7e504f50aec0019c1947cce5 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.618623 20003 tablet_replica.cc:331] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.619176 20003 raft_consensus.cc:2238] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.619583 20003 raft_consensus.cc:2267] T c714104a3f784fa2a8dbab3a26b67e16 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.621294 20003 tablet_replica.cc:331] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.621822 20003 raft_consensus.cc:2238] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.622212 20003 raft_consensus.cc:2267] T b920d950f0d3444d9fff00a1bad09dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.623942 20003 tablet_replica.cc:331] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.624481 20003 raft_consensus.cc:2238] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.624891 20003 raft_consensus.cc:2267] T 7e21bd94dd8648d09b26343df6230d65 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.626724 20003 tablet_replica.cc:331] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.627377 20003 raft_consensus.cc:2238] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.627823 20003 raft_consensus.cc:2267] T 3370e7f927b540069bc6fe3599a7f555 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.629570 20003 tablet_replica.cc:331] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.630064 20003 raft_consensus.cc:2238] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.630970 20003 raft_consensus.cc:2267] T 3991f36cf1024599a42cd83ea8bbd158 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.633370 20003 tablet_replica.cc:331] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.633889 20003 raft_consensus.cc:2238] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.634565 20003 raft_consensus.cc:2267] T 4d0bc120aef54405ad4ea7aee525a029 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.636184 20003 tablet_replica.cc:331] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.636682 20003 raft_consensus.cc:2238] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.637188 20003 raft_consensus.cc:2267] T 9fa9778f2eb54207aea2f47f9037b443 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.638782 20003 tablet_replica.cc:331] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.639266 20003 raft_consensus.cc:2238] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.639737 20003 raft_consensus.cc:2267] T 8b90fd0d512143d7ba14c703e675aeaf P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.641225 20003 tablet_replica.cc:331] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.641717 20003 raft_consensus.cc:2238] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.642087 20003 raft_consensus.cc:2267] T fbf52261cbf144de9a86b9f32c5ed7f0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.643808 20003 tablet_replica.cc:331] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.644269 20003 raft_consensus.cc:2238] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.644610 20003 raft_consensus.cc:2267] T c0107e66d7794efeb3ab5f03388ecae1 P f5d1eaae36f84176860e3799d49e4f53 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.646004 20003 tablet_replica.cc:331] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.646458 20003 raft_consensus.cc:2238] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.646836 20003 raft_consensus.cc:2267] T 6f7c70db395b4c95bdd3a519fbff09f1 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.648499 20003 tablet_replica.cc:331] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.648994 20003 raft_consensus.cc:2238] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.649608 20003 raft_consensus.cc:2267] T 703480173d7142d0b22a2ec903e1707d P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.651890 20003 tablet_replica.cc:331] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
W20250109 21:10:50.652388 21288 consensus_peers.cc:487] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.652503 20003 raft_consensus.cc:2238] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.652961 20003 raft_consensus.cc:2267] T b4695aea7c274b7e830e07c2fdbb1dc6 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.654604 20003 tablet_replica.cc:331] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.655136 20003 raft_consensus.cc:2238] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.655779 20003 raft_consensus.cc:2267] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.657505 20003 tablet_replica.cc:331] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.658195 20003 raft_consensus.cc:2238] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.658797 20003 raft_consensus.cc:2267] T 1fa09aa7e53c4ba9a22836b10b7a8446 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.661150 20003 tablet_replica.cc:331] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.661752 20003 raft_consensus.cc:2238] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.662276 20003 raft_consensus.cc:2267] T d399e14db94b4089b4e14d1212dee628 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.664456 20003 tablet_replica.cc:331] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.665011 20003 raft_consensus.cc:2238] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.665869 20003 raft_consensus.cc:2267] T c941548822ea4678abcf5c764a2d24a4 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.667613 20003 tablet_replica.cc:331] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.668066 20003 raft_consensus.cc:2238] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.668836 20003 raft_consensus.cc:2267] T bba485e8800045ec8e33924e02890beb P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.670904 21843 consensus_peers.cc:487] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.671511 20003 tablet_replica.cc:331] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.672364 20003 raft_consensus.cc:2238] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.673326 20003 raft_consensus.cc:2267] T 0a65a2d287ce4921be6fe0d816e85fd8 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.675438 20003 tablet_replica.cc:331] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.676051 20003 raft_consensus.cc:2238] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.676781 20003 raft_consensus.cc:2267] T 16dee0cc12b842ec877d167505529061 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.679008 20003 tablet_replica.cc:331] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.679576 20003 raft_consensus.cc:2238] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250109 21:10:50.679770 21288 consensus_peers.cc:487] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.680059 20003 raft_consensus.cc:2267] T a619c9914d0d497ab180faa27e65a541 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.681865 20003 tablet_replica.cc:331] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.682343 20003 raft_consensus.cc:2238] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.682770 20003 raft_consensus.cc:2267] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.684401 20003 tablet_replica.cc:331] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.684852 20003 raft_consensus.cc:2238] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.685489 20003 raft_consensus.cc:2267] T fc2136d77ff941c8aee442e2c39c95bb P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.687014 20003 tablet_replica.cc:331] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.687495 20003 raft_consensus.cc:2238] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.688170 20003 raft_consensus.cc:2267] T 79be174d43c746b8bb3e3f401cef0c4f P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.690544 20003 tablet_replica.cc:331] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.691272 20003 raft_consensus.cc:2238] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.691802 20003 raft_consensus.cc:2267] T 0c81c3f41770456c82eac4f8e6aa7552 P f5d1eaae36f84176860e3799d49e4f53 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.694252 20003 tablet_replica.cc:331] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.694839 20003 raft_consensus.cc:2238] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.695361 20003 raft_consensus.cc:2267] T 4271f4a728084e65b74f13aa9fa0c6c0 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.697099 20003 tablet_replica.cc:331] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.697547 20003 raft_consensus.cc:2238] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.697901 20003 raft_consensus.cc:2267] T 8bfae02cdbdc49daa617467659ffaed6 P f5d1eaae36f84176860e3799d49e4f53 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.700057 20003 tablet_replica.cc:331] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.700526 20003 raft_consensus.cc:2238] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.700888 20003 raft_consensus.cc:2267] T 07149574483a42e6849046b112072921 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.702525 20003 tablet_replica.cc:331] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.702976 20003 raft_consensus.cc:2238] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.703372 20003 raft_consensus.cc:2267] T 61283e0a72e04a589880431a717f04f3 P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.705379 20003 tablet_replica.cc:331] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53: stopping tablet replica
I20250109 21:10:50.705883 20003 raft_consensus.cc:2238] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.706569 20003 raft_consensus.cc:2267] T 261b93a35aef4c86b6bfb6648305855d P f5d1eaae36f84176860e3799d49e4f53 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.747946 21288 consensus_peers.cc:487] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.748618 21288 consensus_peers.cc:487] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.759011 21288 consensus_peers.cc:487] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.779112 21288 consensus_peers.cc:487] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.785162 20003 tablet_server.cc:195] TabletServer@127.19.136.194:0 shutdown complete.
W20250109 21:10:50.848698 21288 consensus_peers.cc:487] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.863560 21843 consensus_peers.cc:487] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.874943 21843 consensus_peers.cc:487] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.880235 20003 tablet_server.cc:178] TabletServer@127.19.136.195:0 shutting down...
W20250109 21:10:50.898486 21843 consensus_peers.cc:487] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.905021 21844 consensus_peers.cc:487] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.919517 21844 consensus_peers.cc:487] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:50.920487 21288 consensus_peers.cc:487] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.920540 22776 raft_consensus.cc:491] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
I20250109 21:10:50.921283 22776 raft_consensus.cc:513] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:50.923379 22776 leader_election.cc:290] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:50.929358 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:10:50.930330 20003 tablet_replica.cc:331] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
W20250109 21:10:50.930433 21843 leader_election.cc:336] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
I20250109 21:10:50.931316 20003 raft_consensus.cc:2238] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.932108 20003 raft_consensus.cc:2267] T 33a9dea3cbbb40abbdf4eb26e597f857 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.933540 21843 leader_election.cc:336] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111)
I20250109 21:10:50.933969 21843 leader_election.cc:304] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:50.934572 20003 tablet_replica.cc:331] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.934639 22776 raft_consensus.cc:2743] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:50.935361 20003 raft_consensus.cc:2238] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.935760 20003 raft_consensus.cc:2267] T 2f76b5c3db5e4c1885ce16d810372999 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.937438 20003 tablet_replica.cc:331] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.937918 20003 raft_consensus.cc:2238] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.938280 20003 raft_consensus.cc:2267] T 897320ddfb174b3c9c5751844ec65430 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.939882 20003 tablet_replica.cc:331] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.940384 20003 raft_consensus.cc:2238] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.940760 20003 raft_consensus.cc:2267] T ec98ab18b5ba44949aeef1a8a519bb67 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.942276 20003 tablet_replica.cc:331] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.942764 20003 raft_consensus.cc:2238] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.943208 20003 raft_consensus.cc:2267] T 2963062e448e46b3b27c83dd6c77b956 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.944730 20003 tablet_replica.cc:331] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.945212 20003 raft_consensus.cc:2238] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.945592 20003 raft_consensus.cc:2267] T 9add3f091006404a8cbf90aef76b0c5d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.947154 20003 tablet_replica.cc:331] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.947738 20003 raft_consensus.cc:2238] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.948249 20003 raft_consensus.cc:2267] T f8fab7dbf6344706915ff7ec21cc5430 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.950580 20003 tablet_replica.cc:331] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.951157 20003 raft_consensus.cc:2238] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.951876 20003 raft_consensus.cc:2267] T b45a48f8e1e34fba9a5089b31d8966e7 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.953389 20003 tablet_replica.cc:331] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.953872 20003 raft_consensus.cc:2238] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.954334 20003 raft_consensus.cc:2267] T e719827258244d4c9a82be8775a044f5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.955878 20003 tablet_replica.cc:331] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.956341 20003 raft_consensus.cc:2238] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.956987 20003 raft_consensus.cc:2267] T b920d950f0d3444d9fff00a1bad09dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.958791 20003 tablet_replica.cc:331] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.959368 20003 raft_consensus.cc:2238] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.959820 20003 raft_consensus.cc:2267] T 7a4ca66c3087428aaf05f37bc1ba32ee P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.960353 21844 consensus_peers.cc:487] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.961565 20003 tablet_replica.cc:331] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.962080 20003 raft_consensus.cc:2238] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.962430 20003 raft_consensus.cc:2267] T 909c8965e81d4f84a75ef2fd61bcbe72 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.964007 20003 tablet_replica.cc:331] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.964483 20003 raft_consensus.cc:2238] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.965082 20003 raft_consensus.cc:2267] T 65dabcea5fff4017b727f2fcdee56246 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.966558 20003 tablet_replica.cc:331] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.967075 20003 raft_consensus.cc:2238] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.967494 20003 raft_consensus.cc:2267] T c404ac7e616f4de9b6df5a2d9259a4b6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.969030 20003 tablet_replica.cc:331] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.969516 20003 raft_consensus.cc:2238] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.969888 20003 raft_consensus.cc:2267] T 625c888e7e504f50aec0019c1947cce5 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.971752 20003 tablet_replica.cc:331] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.972365 20003 raft_consensus.cc:2238] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.972831 20003 raft_consensus.cc:2267] T 41937a55ec6c4990b362365d82685977 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:50.973924 21843 consensus_peers.cc:487] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:50.974776 20003 tablet_replica.cc:331] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.975327 20003 raft_consensus.cc:2238] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.976073 20003 raft_consensus.cc:2267] T c714104a3f784fa2a8dbab3a26b67e16 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.977811 20003 tablet_replica.cc:331] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.978556 20003 raft_consensus.cc:2238] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.979024 20003 raft_consensus.cc:2267] T 44dc7037c0cc4926b2e36fab2a05a11a P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.981187 20003 tablet_replica.cc:331] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.981901 20003 raft_consensus.cc:2238] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.982471 20003 raft_consensus.cc:2267] T 3991f36cf1024599a42cd83ea8bbd158 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.985152 20003 tablet_replica.cc:331] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.985833 20003 raft_consensus.cc:2238] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.986336 20003 raft_consensus.cc:2267] T 4d0bc120aef54405ad4ea7aee525a029 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.988045 20003 tablet_replica.cc:331] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.988523 20003 raft_consensus.cc:2238] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.989125 20003 raft_consensus.cc:2267] T 3370e7f927b540069bc6fe3599a7f555 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.990541 20003 tablet_replica.cc:331] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.991031 20003 raft_consensus.cc:2238] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.991470 20003 raft_consensus.cc:2267] T bba485e8800045ec8e33924e02890beb P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.993284 20003 tablet_replica.cc:331] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.993757 20003 raft_consensus.cc:2238] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.994192 20003 raft_consensus.cc:2267] T 0a65a2d287ce4921be6fe0d816e85fd8 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.995669 20003 tablet_replica.cc:331] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.996119 20003 raft_consensus.cc:2238] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:50.996449 20003 raft_consensus.cc:2267] T fc2136d77ff941c8aee442e2c39c95bb P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:50.997877 20003 tablet_replica.cc:331] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:50.998319 20003 raft_consensus.cc:2238] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:50.999064 20003 raft_consensus.cc:2267] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.000777 20003 tablet_replica.cc:331] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.001318 20003 raft_consensus.cc:2238] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.001749 20003 raft_consensus.cc:2267] T 800dbae8cc64427c8e80cc1ac7b42769 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.002462 22776 raft_consensus.cc:491] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
I20250109 21:10:51.002993 22776 raft_consensus.cc:513] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:51.004109 20003 tablet_replica.cc:331] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.004879 20003 raft_consensus.cc:2238] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.004993 22776 leader_election.cc:290] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:51.005376 20003 raft_consensus.cc:2267] T b3b31fe68ef047b3b126d525dd19991d P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.007674 20003 tablet_replica.cc:331] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
W20250109 21:10:51.008412 21844 leader_election.cc:336] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250109 21:10:51.008412 20003 raft_consensus.cc:2238] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.009303 20003 raft_consensus.cc:2267] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.014132 22776 raft_consensus.cc:491] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
I20250109 21:10:51.015092 20003 tablet_replica.cc:331] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
W20250109 21:10:51.015002 21843 leader_election.cc:336] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
I20250109 21:10:51.014706 22776 raft_consensus.cc:513] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:51.015517 21843 leader_election.cc:304] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:51.015933 20003 raft_consensus.cc:2238] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.016280 22805 raft_consensus.cc:2743] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:10:51.016655 22776 leader_election.cc:290] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:51.016885 20003 raft_consensus.cc:2267] T fbf52261cbf144de9a86b9f32c5ed7f0 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.019444 20003 tablet_replica.cc:331] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.020298 20003 raft_consensus.cc:2238] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 3 LEADER]: Raft consensus shutting down.
W20250109 21:10:51.020246 21843 leader_election.cc:336] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
W20250109 21:10:51.021027 21843 leader_election.cc:336] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111)
I20250109 21:10:51.021409 20003 raft_consensus.cc:2267] T c0107e66d7794efeb3ab5f03388ecae1 P 0175ef2fbd0349568ba2bf83788476ea [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.021396 21843 leader_election.cc:304] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:51.022080 22776 raft_consensus.cc:2743] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:51.023366 20003 tablet_replica.cc:331] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.023896 20003 raft_consensus.cc:2238] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.024274 20003 raft_consensus.cc:2267] T 5bb0a4ab14fe49cd9d565ffe64396929 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.025849 20003 tablet_replica.cc:331] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.026309 20003 raft_consensus.cc:2238] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.026674 20003 raft_consensus.cc:2267] T f75eb10b9fad472794f2398d9f305706 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.028242 20003 tablet_replica.cc:331] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.028704 20003 raft_consensus.cc:2238] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.029321 20003 raft_consensus.cc:2267] T b4695aea7c274b7e830e07c2fdbb1dc6 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.030836 20003 tablet_replica.cc:331] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.031503 20003 raft_consensus.cc:2238] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.031919 20003 raft_consensus.cc:2267] T 28f6a07c6bbe4fcbadfe6fe3c94f913a P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.033958 20003 tablet_replica.cc:331] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.034565 20003 raft_consensus.cc:2238] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.035390 20003 raft_consensus.cc:2267] T 35869458d4934257a5392c4158bc4cd1 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.037410 20003 tablet_replica.cc:331] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.038046 20003 raft_consensus.cc:2238] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.038460 20003 raft_consensus.cc:2267] T 0c81c3f41770456c82eac4f8e6aa7552 P 0175ef2fbd0349568ba2bf83788476ea [term 4 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:51.038954 21843 consensus_peers.cc:487] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Couldn't send request to peer f5d1eaae36f84176860e3799d49e4f53. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:51.040177 20003 tablet_replica.cc:331] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.040702 20003 raft_consensus.cc:2238] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.041056 20003 raft_consensus.cc:2267] T f660a562716e4048a180570218fae1d4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.042598 20003 tablet_replica.cc:331] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.043104 20003 raft_consensus.cc:2238] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.043488 20003 raft_consensus.cc:2267] T 16dee0cc12b842ec877d167505529061 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.045099 20003 tablet_replica.cc:331] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.045707 20003 raft_consensus.cc:2238] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.046375 20003 raft_consensus.cc:2267] T c77aca60924f40f68ecc7531984ef0cc P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.048048 20003 tablet_replica.cc:331] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.048475 20003 raft_consensus.cc:2238] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.048914 20003 raft_consensus.cc:2267] T c941548822ea4678abcf5c764a2d24a4 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.050374 20003 tablet_replica.cc:331] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.050786 20003 raft_consensus.cc:2238] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.051481 20003 raft_consensus.cc:2267] T d399e14db94b4089b4e14d1212dee628 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.053020 20003 tablet_replica.cc:331] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.053388 20003 raft_consensus.cc:2238] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.054163 20003 raft_consensus.cc:2267] T 261b93a35aef4c86b6bfb6648305855d P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.056227 20003 tablet_replica.cc:331] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.056711 20003 raft_consensus.cc:2238] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Raft consensus shutting down.
W20250109 21:10:51.056816 21844 consensus_peers.cc:487] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:51.057502 20003 raft_consensus.cc:2267] T 97a78c4d7c18498690c424edd11b94a5 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.059137 20003 tablet_replica.cc:331] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.059566 20003 raft_consensus.cc:2238] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.059881 20003 raft_consensus.cc:2267] T 8bfae02cdbdc49daa617467659ffaed6 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.061450 20003 tablet_replica.cc:331] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.061866 20003 raft_consensus.cc:2238] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.062211 20003 raft_consensus.cc:2267] T 07149574483a42e6849046b112072921 P 0175ef2fbd0349568ba2bf83788476ea [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.063908 20003 tablet_replica.cc:331] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea: stopping tablet replica
I20250109 21:10:51.064340 20003 raft_consensus.cc:2238] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.065029 20003 raft_consensus.cc:2267] T a619c9914d0d497ab180faa27e65a541 P 0175ef2fbd0349568ba2bf83788476ea [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:51.066766 21844 consensus_peers.cc:487] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:51.130264 21844 consensus_peers.cc:487] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.195:46241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:51.135483 20003 tablet_server.cc:195] TabletServer@127.19.136.195:0 shutdown complete.
I20250109 21:10:51.162392 22776 raft_consensus.cc:491] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
I20250109 21:10:51.162979 22776 raft_consensus.cc:513] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:51.164726 22776 leader_election.cc:290] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
W20250109 21:10:51.168488 21843 leader_election.cc:336] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
I20250109 21:10:51.169292 22776 raft_consensus.cc:491] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
W20250109 21:10:51.169350 21843 leader_election.cc:336] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111)
I20250109 21:10:51.169907 21843 leader_election.cc:304] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:51.169723 22776 raft_consensus.cc:513] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:51.171293 22805 raft_consensus.cc:2743] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:51.171976 22776 leader_election.cc:290] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
W20250109 21:10:51.175822 21843 leader_election.cc:336] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
W20250109 21:10:51.176476 21843 leader_election.cc:336] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111)
I20250109 21:10:51.176764 21843 leader_election.cc:304] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:51.177289 22776 raft_consensus.cc:2743] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:10:51.182286 22805 raft_consensus.cc:491] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
I20250109 21:10:51.182690 22805 raft_consensus.cc:513] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:51.184710 22805 leader_election.cc:290] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
W20250109 21:10:51.187242 21844 consensus_peers.cc:487] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.195:46241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:51.191023 21843 leader_election.cc:336] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
W20250109 21:10:51.191653 21843 leader_election.cc:336] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111)
I20250109 21:10:51.191941 21843 leader_election.cc:304] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:51.192520 22805 raft_consensus.cc:2743] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:51.219835 20003 tablet_server.cc:178] TabletServer@127.19.136.196:0 shutting down...
W20250109 21:10:51.223568 21844 consensus_peers.cc:487] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.195:46241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:51.235383 22776 raft_consensus.cc:491] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
I20250109 21:10:51.235832 22776 raft_consensus.cc:513] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: 5 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:51.237565 22776 leader_election.cc:290] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
W20250109 21:10:51.241956 21844 leader_election.cc:336] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Network error: Client connection negotiation failed: client connection to 127.19.136.195:46241: connect: Connection refused (error 111)
W20250109 21:10:51.247018 21844 consensus_peers.cc:487] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.195:46241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:51.247429 21843 leader_election.cc:336] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 4 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
I20250109 21:10:51.247907 21843 leader_election.cc:304] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:51.248490 22776 raft_consensus.cc:2743] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250109 21:10:51.262220 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:10:51.263011 20003 tablet_replica.cc:331] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.263629 20003 raft_consensus.cc:2238] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.264091 20003 raft_consensus.cc:2267] T f8fab7dbf6344706915ff7ec21cc5430 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.266077 20003 tablet_replica.cc:331] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.266614 20003 raft_consensus.cc:2238] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.267104 20003 raft_consensus.cc:2267] T b45a48f8e1e34fba9a5089b31d8966e7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.268658 20003 tablet_replica.cc:331] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.269168 20003 raft_consensus.cc:2238] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.269618 20003 raft_consensus.cc:2267] T e719827258244d4c9a82be8775a044f5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.271328 20003 tablet_replica.cc:331] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.272084 20003 raft_consensus.cc:2238] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.272548 20003 raft_consensus.cc:2267] T 65dabcea5fff4017b727f2fcdee56246 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.274200 20003 tablet_replica.cc:331] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.274711 20003 raft_consensus.cc:2238] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.275146 20003 raft_consensus.cc:2267] T 8a822be40fe74d1a8c6ab5aec62bcb14 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.276676 20003 tablet_replica.cc:331] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.277195 20003 raft_consensus.cc:2238] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.277637 20003 raft_consensus.cc:2267] T 97a78c4d7c18498690c424edd11b94a5 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.282351 20003 tablet_replica.cc:331] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.282876 20003 raft_consensus.cc:2238] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.283561 20003 raft_consensus.cc:2267] T abb16506c36a4e58a36455d201947d07 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.285072 20003 tablet_replica.cc:331] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.285818 20003 raft_consensus.cc:2238] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.286343 20003 raft_consensus.cc:2267] T f75eb10b9fad472794f2398d9f305706 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.288030 20003 tablet_replica.cc:331] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.288537 20003 raft_consensus.cc:2238] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 LEADER]: Raft consensus shutting down.
W20250109 21:10:51.288872 21844 consensus_peers.cc:487] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 -> Peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Couldn't send request to peer 0175ef2fbd0349568ba2bf83788476ea. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.195:46241: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:51.289203 20003 raft_consensus.cc:2267] T ec98ab18b5ba44949aeef1a8a519bb67 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.290853 20003 tablet_replica.cc:331] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.291419 20003 raft_consensus.cc:2238] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.291812 20003 raft_consensus.cc:2267] T 79be174d43c746b8bb3e3f401cef0c4f P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.293285 20003 tablet_replica.cc:331] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.293794 20003 raft_consensus.cc:2238] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.294235 20003 raft_consensus.cc:2267] T 80bbbef4a3bd4a8789ff1a631b7f36e4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.295831 20003 tablet_replica.cc:331] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.296327 20003 raft_consensus.cc:2238] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.296764 20003 raft_consensus.cc:2267] T 703480173d7142d0b22a2ec903e1707d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.298309 20003 tablet_replica.cc:331] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.298581 22776 raft_consensus.cc:491] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
I20250109 21:10:51.298802 20003 raft_consensus.cc:2238] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.299368 20003 raft_consensus.cc:2267] T 800dbae8cc64427c8e80cc1ac7b42769 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.299018 22776 raft_consensus.cc:513] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "0175ef2fbd0349568ba2bf83788476ea" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 46241 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:51.300696 22776 leader_election.cc:290] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241)
I20250109 21:10:51.301360 20003 tablet_replica.cc:331] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.301893 20003 raft_consensus.cc:2238] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.302680 20003 raft_consensus.cc:2267] T 0c81c3f41770456c82eac4f8e6aa7552 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 4 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:51.304229 21843 leader_election.cc:336] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
I20250109 21:10:51.304785 20003 tablet_replica.cc:331] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
W20250109 21:10:51.304762 21844 leader_election.cc:336] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 0175ef2fbd0349568ba2bf83788476ea (127.19.136.195:46241): Network error: Client connection negotiation failed: client connection to 127.19.136.195:46241: connect: Connection refused (error 111)
I20250109 21:10:51.305308 21844 leader_election.cc:304] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 0175ef2fbd0349568ba2bf83788476ea, 1774487f18694af1a5340fc8486cff53
I20250109 21:10:51.305541 20003 raft_consensus.cc:2238] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.305796 22776 raft_consensus.cc:2743] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:51.306017 20003 raft_consensus.cc:2267] T 3991f36cf1024599a42cd83ea8bbd158 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.308599 20003 tablet_replica.cc:331] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.309263 20003 raft_consensus.cc:2238] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.309697 20003 raft_consensus.cc:2267] T 4271f4a728084e65b74f13aa9fa0c6c0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.311233 20003 tablet_replica.cc:331] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.311695 20003 raft_consensus.cc:2238] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.312119 20003 raft_consensus.cc:2267] T f8d059ec48cb46dfac04405794b984ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.313591 20003 tablet_replica.cc:331] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.314056 20003 raft_consensus.cc:2238] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.314500 20003 raft_consensus.cc:2267] T 35869458d4934257a5392c4158bc4cd1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.316054 20003 tablet_replica.cc:331] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.316543 20003 raft_consensus.cc:2238] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.316951 20003 raft_consensus.cc:2267] T 2963062e448e46b3b27c83dd6c77b956 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.318516 20003 tablet_replica.cc:331] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.319025 20003 raft_consensus.cc:2238] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.319413 20003 raft_consensus.cc:2267] T c77aca60924f40f68ecc7531984ef0cc P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.320842 20003 tablet_replica.cc:331] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.321303 20003 raft_consensus.cc:2238] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.321986 20003 raft_consensus.cc:2267] T 7a4ca66c3087428aaf05f37bc1ba32ee P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.323587 20003 tablet_replica.cc:331] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.324033 20003 raft_consensus.cc:2238] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.324476 20003 raft_consensus.cc:2267] T b3b31fe68ef047b3b126d525dd19991d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.325901 20003 tablet_replica.cc:331] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.326330 20003 raft_consensus.cc:2238] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.326983 20003 raft_consensus.cc:2267] T 1fa09aa7e53c4ba9a22836b10b7a8446 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.328476 20003 tablet_replica.cc:331] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.328922 20003 raft_consensus.cc:2238] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.329042 22776 raft_consensus.cc:491] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 1774487f18694af1a5340fc8486cff53)
I20250109 21:10:51.329595 20003 raft_consensus.cc:2267] T c714104a3f784fa2a8dbab3a26b67e16 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.329563 22776 raft_consensus.cc:513] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: 4 OBSOLETE_local: false peers { permanent_uuid: "1774487f18694af1a5340fc8486cff53" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 33243 } } peers { permanent_uuid: "f5d1eaae36f84176860e3799d49e4f53" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 44109 } } peers { permanent_uuid: "59024e0e40b941ad9d0df6bb6bc4f4f5" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 33191 } attrs { promote: false } }
I20250109 21:10:51.331730 22776 leader_election.cc:290] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243), f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109)
I20250109 21:10:51.332010 20003 tablet_replica.cc:331] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.332674 20003 raft_consensus.cc:2238] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.333308 20003 raft_consensus.cc:2267] T 73f91268c8384e79a83979ffd1c00d99 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:10:51.335009 21843 leader_election.cc:336] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
I20250109 21:10:51.335395 20003 tablet_replica.cc:331] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
W20250109 21:10:51.335496 21843 leader_election.cc:336] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer f5d1eaae36f84176860e3799d49e4f53 (127.19.136.194:44109): Network error: Client connection negotiation failed: client connection to 127.19.136.194:44109: connect: Connection refused (error 111)
I20250109 21:10:51.335857 21843 leader_election.cc:304] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 59024e0e40b941ad9d0df6bb6bc4f4f5; no voters: 1774487f18694af1a5340fc8486cff53, f5d1eaae36f84176860e3799d49e4f53
I20250109 21:10:51.336043 20003 raft_consensus.cc:2238] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.336339 22776 raft_consensus.cc:2743] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:51.336673 20003 raft_consensus.cc:2267] T bba485e8800045ec8e33924e02890beb P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.338663 20003 tablet_replica.cc:331] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.339155 20003 raft_consensus.cc:2238] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.339581 20003 raft_consensus.cc:2267] T c941548822ea4678abcf5c764a2d24a4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.340976 20003 tablet_replica.cc:331] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.341456 20003 raft_consensus.cc:2238] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.341841 20003 raft_consensus.cc:2267] T 0a65a2d287ce4921be6fe0d816e85fd8 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.343356 20003 tablet_replica.cc:331] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.343806 20003 raft_consensus.cc:2238] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.344234 20003 raft_consensus.cc:2267] T 261b93a35aef4c86b6bfb6648305855d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.345753 20003 tablet_replica.cc:331] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.346194 20003 raft_consensus.cc:2238] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.346827 20003 raft_consensus.cc:2267] T 61283e0a72e04a589880431a717f04f3 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.348410 20003 tablet_replica.cc:331] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.348840 20003 raft_consensus.cc:2238] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.349285 20003 raft_consensus.cc:2267] T fbf52261cbf144de9a86b9f32c5ed7f0 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.350766 20003 tablet_replica.cc:331] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.351233 20003 raft_consensus.cc:2238] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.351874 20003 raft_consensus.cc:2267] T 44dc7037c0cc4926b2e36fab2a05a11a P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.353399 20003 tablet_replica.cc:331] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.353822 20003 raft_consensus.cc:2238] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.354465 20003 raft_consensus.cc:2267] T 9add3f091006404a8cbf90aef76b0c5d P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.355947 20003 tablet_replica.cc:331] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.356391 20003 raft_consensus.cc:2238] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.356806 20003 raft_consensus.cc:2267] T 33a9dea3cbbb40abbdf4eb26e597f857 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.358274 20003 tablet_replica.cc:331] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.358717 20003 raft_consensus.cc:2238] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.359153 20003 raft_consensus.cc:2267] T 9fa9778f2eb54207aea2f47f9037b443 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.360654 20003 tablet_replica.cc:331] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.361120 20003 raft_consensus.cc:2238] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.361783 20003 raft_consensus.cc:2267] T 8b90fd0d512143d7ba14c703e675aeaf P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.363337 20003 tablet_replica.cc:331] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.363808 20003 raft_consensus.cc:2238] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.364435 20003 raft_consensus.cc:2267] T 909c8965e81d4f84a75ef2fd61bcbe72 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.365948 20003 tablet_replica.cc:331] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.366427 20003 raft_consensus.cc:2238] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.367081 20003 raft_consensus.cc:2267] T f660a562716e4048a180570218fae1d4 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.368570 20003 tablet_replica.cc:331] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.368997 20003 raft_consensus.cc:2238] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.369632 20003 raft_consensus.cc:2267] T 7e21bd94dd8648d09b26343df6230d65 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.371213 20003 tablet_replica.cc:331] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.371686 20003 raft_consensus.cc:2238] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.372084 20003 raft_consensus.cc:2267] T 4a96090bb1b54bf1b35f150050e71ee7 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.373625 20003 tablet_replica.cc:331] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.374046 20003 raft_consensus.cc:2238] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.374507 20003 raft_consensus.cc:2267] T c0107e66d7794efeb3ab5f03388ecae1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.376060 20003 tablet_replica.cc:331] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.376524 20003 raft_consensus.cc:2238] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:10:51.376943 20003 raft_consensus.cc:2267] T 6f7c70db395b4c95bdd3a519fbff09f1 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.378446 20003 tablet_replica.cc:331] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.378818 20003 raft_consensus.cc:2238] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.379524 20003 raft_consensus.cc:2267] T 5bb0a4ab14fe49cd9d565ffe64396929 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.381004 20003 tablet_replica.cc:331] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5: stopping tablet replica
I20250109 21:10:51.381361 20003 raft_consensus.cc:2238] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.382052 20003 raft_consensus.cc:2267] T 07149574483a42e6849046b112072921 P 59024e0e40b941ad9d0df6bb6bc4f4f5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.437971 20003 tablet_server.cc:195] TabletServer@127.19.136.196:0 shutdown complete.
I20250109 21:10:51.496389 20003 master.cc:537] Master@127.19.136.254:44891 shutting down...
W20250109 21:10:51.523468 21117 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Catalog manager is not initialized. State: Closing
W20250109 21:10:51.572484 21055 catalog_manager.cc:4615] TS 1774487f18694af1a5340fc8486cff53 (127.19.136.193:33243): DeleteTablet:TABLET_DATA_TOMBSTONED RPC failed for tablet 261b93a35aef4c86b6bfb6648305855d: Network error: Client connection negotiation failed: client connection to 127.19.136.193:33243: connect: Connection refused (error 111)
I20250109 21:10:51.730146 20003 raft_consensus.cc:2238] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:10:51.730645 20003 raft_consensus.cc:2267] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:10:51.730957 20003 tablet_replica.cc:331] T 00000000000000000000000000000000 P b6f074c68ddf4e09bcad877ccc2bfc45: stopping tablet replica
I20250109 21:10:51.752763 20003 master.cc:559] Master@127.19.136.254:44891 shutdown complete.
[ OK ] LeaderRebalancerTest.AddTserver (48397 ms)
[ RUN ] LeaderRebalancerTest.RestartTserver
I20250109 21:10:51.844790 20003 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.136.254:39877
I20250109 21:10:51.845876 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:51.852293 22808 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:51.853369 22809 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:51.853506 22811 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:51.855881 20003 server_base.cc:1034] running on GCE node
I20250109 21:10:51.857069 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:10:51.857265 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:51.857421 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457051857386 us; error 0 us; skew 500 ppm
I20250109 21:10:51.857899 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:51.860272 20003 webserver.cc:458] Webserver started at http://127.19.136.254:42649/ using document root <none> and password file <none>
I20250109 21:10:51.860739 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:51.860906 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:51.861137 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:51.862200 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/master-0-root/instance:
uuid: "e180793815af495b9df31cdc04450648"
format_stamp: "Formatted at 2025-01-09 21:10:51 on dist-test-slave-sc47"
I20250109 21:10:51.866444 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.000s sys 0.006s
I20250109 21:10:51.869506 22816 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:51.870167 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250109 21:10:51.870433 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/master-0-root
uuid: "e180793815af495b9df31cdc04450648"
format_stamp: "Formatted at 2025-01-09 21:10:51 on dist-test-slave-sc47"
I20250109 21:10:51.870697 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:51.892884 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:51.894076 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:51.931926 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.254:39877
I20250109 21:10:51.932022 22867 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.254:39877 every 8 connection(s)
I20250109 21:10:51.935685 22868 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:51.945191 22868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648: Bootstrap starting.
I20250109 21:10:51.949792 22868 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:51.953799 22868 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648: No bootstrap required, opened a new log
I20250109 21:10:51.955746 22868 raft_consensus.cc:357] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180793815af495b9df31cdc04450648" member_type: VOTER }
I20250109 21:10:51.956111 22868 raft_consensus.cc:383] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:51.956329 22868 raft_consensus.cc:738] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e180793815af495b9df31cdc04450648, State: Initialized, Role: FOLLOWER
I20250109 21:10:51.956826 22868 consensus_queue.cc:260] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180793815af495b9df31cdc04450648" member_type: VOTER }
I20250109 21:10:51.957243 22868 raft_consensus.cc:397] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250109 21:10:51.957460 22868 raft_consensus.cc:491] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250109 21:10:51.957700 22868 raft_consensus.cc:3054] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:51.962239 22868 raft_consensus.cc:513] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180793815af495b9df31cdc04450648" member_type: VOTER }
I20250109 21:10:51.962713 22868 leader_election.cc:304] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: e180793815af495b9df31cdc04450648; no voters:
I20250109 21:10:51.963810 22868 leader_election.cc:290] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250109 21:10:51.964105 22871 raft_consensus.cc:2798] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:51.965332 22871 raft_consensus.cc:695] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 1 LEADER]: Becoming Leader. State: Replica: e180793815af495b9df31cdc04450648, State: Running, Role: LEADER
I20250109 21:10:51.965931 22871 consensus_queue.cc:237] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180793815af495b9df31cdc04450648" member_type: VOTER }
I20250109 21:10:51.966759 22868 sys_catalog.cc:564] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [sys.catalog]: configured and running, proceeding with master startup.
I20250109 21:10:51.970696 22872 sys_catalog.cc:455] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "e180793815af495b9df31cdc04450648" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180793815af495b9df31cdc04450648" member_type: VOTER } }
I20250109 21:10:51.972376 22872 sys_catalog.cc:458] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [sys.catalog]: This master's current role is: LEADER
I20250109 21:10:51.971697 22873 sys_catalog.cc:455] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [sys.catalog]: SysCatalogTable state changed. Reason: New leader e180793815af495b9df31cdc04450648. Latest consensus state: current_term: 1 leader_uuid: "e180793815af495b9df31cdc04450648" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "e180793815af495b9df31cdc04450648" member_type: VOTER } }
I20250109 21:10:51.973696 22873 sys_catalog.cc:458] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [sys.catalog]: This master's current role is: LEADER
I20250109 21:10:51.975857 22880 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250109 21:10:51.983670 22880 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250109 21:10:51.984623 20003 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250109 21:10:51.991850 22880 catalog_manager.cc:1348] Generated new cluster ID: 398c90906381448f9103db11fc0e9556
I20250109 21:10:51.992151 22880 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250109 21:10:52.015404 22880 catalog_manager.cc:1371] Generated new certificate authority record
I20250109 21:10:52.016641 22880 catalog_manager.cc:1505] Loading token signing keys...
I20250109 21:10:52.031622 22880 catalog_manager.cc:5899] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648: Generated new TSK 0
I20250109 21:10:52.032204 22880 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250109 21:10:52.051441 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:52.057354 22889 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:52.058954 22890 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:52.059907 22892 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:52.060664 20003 server_base.cc:1034] running on GCE node
I20250109 21:10:52.061614 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:10:52.061801 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:52.061923 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457052061912 us; error 0 us; skew 500 ppm
I20250109 21:10:52.062377 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:52.064646 20003 webserver.cc:458] Webserver started at http://127.19.136.193:46707/ using document root <none> and password file <none>
I20250109 21:10:52.065070 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:52.065227 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:52.065440 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:52.066463 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/instance:
uuid: "51679b9f547940b6a8311fd6fab340f7"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:10:52.071031 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20250109 21:10:52.074087 22897 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.074805 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:10:52.075119 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
uuid: "51679b9f547940b6a8311fd6fab340f7"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:10:52.075382 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:52.100539 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:52.102074 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:52.104313 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:10:52.107329 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:10:52.107545 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.107862 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:10:52.108086 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.146471 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.193:44075
I20250109 21:10:52.146567 22959 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.193:44075 every 8 connection(s)
I20250109 21:10:52.151124 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:52.159112 22964 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:52.161813 22965 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:52.163566 20003 server_base.cc:1034] running on GCE node
I20250109 21:10:52.164285 22960 heartbeater.cc:346] Connected to a master server at 127.19.136.254:39877
W20250109 21:10:52.164367 22967 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:52.164686 22960 heartbeater.cc:463] Registering TS with master...
I20250109 21:10:52.165342 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20250109 21:10:52.165566 22960 heartbeater.cc:510] Master 127.19.136.254:39877 requested a full tablet report, sending...
W20250109 21:10:52.165644 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:52.165966 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457052165945 us; error 0 us; skew 500 ppm
I20250109 21:10:52.166648 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:52.167703 22833 ts_manager.cc:194] Registered new tserver with Master: 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:52.169340 20003 webserver.cc:458] Webserver started at http://127.19.136.194:42539/ using document root <none> and password file <none>
I20250109 21:10:52.169670 22833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38500
I20250109 21:10:52.169821 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:52.170017 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:52.170233 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:52.171360 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/instance:
uuid: "df8c84b03e6f4a5288bdad949ba2447c"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:10:52.175645 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20250109 21:10:52.178877 22972 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.179584 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250109 21:10:52.179837 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-1-root
uuid: "df8c84b03e6f4a5288bdad949ba2447c"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:10:52.180084 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:52.194619 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:52.195752 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:52.197058 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:10:52.199095 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:10:52.199281 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.199501 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:10:52.199647 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.237401 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.194:39559
I20250109 21:10:52.237493 23035 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.194:39559 every 8 connection(s)
I20250109 21:10:52.241961 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:52.248380 23039 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:52.249689 23040 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:52.252314 23042 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:52.253190 20003 server_base.cc:1034] running on GCE node
I20250109 21:10:52.253221 23036 heartbeater.cc:346] Connected to a master server at 127.19.136.254:39877
I20250109 21:10:52.253779 23036 heartbeater.cc:463] Registering TS with master...
I20250109 21:10:52.254175 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:10:52.254422 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:52.254442 23036 heartbeater.cc:510] Master 127.19.136.254:39877 requested a full tablet report, sending...
I20250109 21:10:52.254611 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457052254598 us; error 0 us; skew 500 ppm
I20250109 21:10:52.255227 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:52.256443 22833 ts_manager.cc:194] Registered new tserver with Master: df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:52.257751 20003 webserver.cc:458] Webserver started at http://127.19.136.195:46269/ using document root <none> and password file <none>
I20250109 21:10:52.257941 22833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38508
I20250109 21:10:52.258242 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:52.258483 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:52.258764 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:52.259913 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/instance:
uuid: "e1a492f3cf3a4827bb0045500a3abb83"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:10:52.264103 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.004s sys 0.000s
I20250109 21:10:52.267014 23047 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.267717 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250109 21:10:52.267961 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-2-root
uuid: "e1a492f3cf3a4827bb0045500a3abb83"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:10:52.268246 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:52.281378 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:52.282582 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:52.283946 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:10:52.286023 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:10:52.286222 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.286430 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:10:52.286578 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.323766 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.195:32985
I20250109 21:10:52.323851 23110 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.195:32985 every 8 connection(s)
I20250109 21:10:52.328590 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:10:52.335443 23114 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:52.336580 23115 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:10:52.339776 23117 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:10:52.339974 23111 heartbeater.cc:346] Connected to a master server at 127.19.136.254:39877
I20250109 21:10:52.340441 23111 heartbeater.cc:463] Registering TS with master...
I20250109 21:10:52.340567 20003 server_base.cc:1034] running on GCE node
I20250109 21:10:52.341173 23111 heartbeater.cc:510] Master 127.19.136.254:39877 requested a full tablet report, sending...
I20250109 21:10:52.341394 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:10:52.341652 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:10:52.341800 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457052341787 us; error 0 us; skew 500 ppm
I20250109 21:10:52.342468 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:10:52.343168 22833 ts_manager.cc:194] Registered new tserver with Master: e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:52.344620 22833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38516
I20250109 21:10:52.345103 20003 webserver.cc:458] Webserver started at http://127.19.136.196:33205/ using document root <none> and password file <none>
I20250109 21:10:52.345672 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:10:52.345851 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:10:52.346084 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:10:52.347220 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-3-root/instance:
uuid: "227e48f30ae84db6bff43cc2860219a3"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:10:52.351442 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.001s
I20250109 21:10:52.354403 23122 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.355141 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.001s
I20250109 21:10:52.355402 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-3-root
uuid: "227e48f30ae84db6bff43cc2860219a3"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:10:52.355674 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-3-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-3-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-3-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:10:52.376108 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:10:52.377313 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:10:52.378568 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:10:52.380676 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:10:52.380870 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.381080 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:10:52.381240 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:10:52.419270 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.196:40347
I20250109 21:10:52.419369 23184 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.196:40347 every 8 connection(s)
I20250109 21:10:52.431638 23185 heartbeater.cc:346] Connected to a master server at 127.19.136.254:39877
I20250109 21:10:52.431985 23185 heartbeater.cc:463] Registering TS with master...
I20250109 21:10:52.432658 23185 heartbeater.cc:510] Master 127.19.136.254:39877 requested a full tablet report, sending...
I20250109 21:10:52.434334 22833 ts_manager.cc:194] Registered new tserver with Master: 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:52.434602 20003 internal_mini_cluster.cc:371] 4 TS(s) registered with all masters after 0.012286205s
I20250109 21:10:52.435628 22833 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:38530
I20250109 21:10:52.436920 20003 test_util.cc:274] Using random seed: 1774664097
I20250109 21:10:52.457311 22833 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:38534:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}""\004\001\000\313c+\002\004\001\000\226\307V\004\004\001\000a+\202\006\004\001\000,\217\255\010\004\001\000\367\362\330\n\004\001\000\302V\004\r\004\001\000\215\272/\017\004\001\000X\036[\021\004\001\000#\202\206\023\004\001\000\356\345\261\025\004\001\000\271I\335\027\004\001\000\204\255\010\032\004\001\000O\0214\034\004\001\000\032u_\036\004\001\000\345\330\212 \004\001\000\260<\266\"\004\001\000{\240\341$\004\001\000F\004\r\'\004\001\000\021h8)\004\001\000\334\313c+\004\001\000\247/\217-\004\001\000r\223\272/\004\001\000=\367\3451\004\001\000\010[\0214\004\001\000\323\276<6\004\001\000\236\"h8\004\001\000i\206\223:\004\001\0004\352\276<\004\001\000\377M\352>\004\001\000\312\261\025A\004\001\000\225\025AC\004\001\000`ylE\004\001\000+\335\227G\004\001\000\366@\303I\004\001\000\301\244\356K\004\001\000\214\010\032N\004\001\000WlEP\004\001\000\"\320pR\004\001\000\3553\234T\004\001\000\270\227\307V\004\001\000\203\373\362X\004\001\000N_\036[\004\001\000\031\303I]\004\001\000\344&u_\004\001\000\257\212\240a\004\001\000z\356\313c\004\001\000ER\367e\004\001\000\020\266\"h\004\001\000\333\031Nj\004\001\000\246}yl\004\001\000q\341\244n\004\001\000<E\320p\004\001\000\007\251\373r\004\001\000\322\014\'u\004\001\000\235pRw\004\001\000h\324}y\004\001\00038\251{\004\001\000\376\233\324}"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
I20250109 21:10:52.689024 23000 tablet_service.cc:1467] Processing CreateTablet for tablet 3fde04e5e5c34372a88503ab457cda0e (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250109 21:10:52.690397 23000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fde04e5e5c34372a88503ab457cda0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.691699 22997 tablet_service.cc:1467] Processing CreateTablet for tablet e7713f12f4e14c9dbf2c0c02c601fec8 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250109 21:10:52.692998 22997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7713f12f4e14c9dbf2c0c02c601fec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.695892 22996 tablet_service.cc:1467] Processing CreateTablet for tablet 39ae691cd7d54ac7b9e143a80bff4799 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250109 21:10:52.697162 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ae691cd7d54ac7b9e143a80bff4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.699913 22995 tablet_service.cc:1467] Processing CreateTablet for tablet 414f03400b5e43529a493c039a7b7024 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250109 21:10:52.701166 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414f03400b5e43529a493c039a7b7024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.703903 22994 tablet_service.cc:1467] Processing CreateTablet for tablet f1ba1f1f4b844cbeafa6098ff5b3a7ce (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250109 21:10:52.705142 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ba1f1f4b844cbeafa6098ff5b3a7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.710979 23075 tablet_service.cc:1467] Processing CreateTablet for tablet 3fde04e5e5c34372a88503ab457cda0e (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250109 21:10:52.711328 22925 tablet_service.cc:1467] Processing CreateTablet for tablet 1a650b5afdf747e5b2efa98da645c5ed (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250109 21:10:52.712606 22925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a650b5afdf747e5b2efa98da645c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.714188 23071 tablet_service.cc:1467] Processing CreateTablet for tablet 46e8872c00294570b6f9beecbcffa034 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250109 21:10:52.715986 22924 tablet_service.cc:1467] Processing CreateTablet for tablet a6503cd8bad54600a24017cfeed153d1 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250109 21:10:52.717371 22924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6503cd8bad54600a24017cfeed153d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.717136 23069 tablet_service.cc:1467] Processing CreateTablet for tablet f1ba1f1f4b844cbeafa6098ff5b3a7ce (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250109 21:10:52.716997 22920 tablet_service.cc:1467] Processing CreateTablet for tablet 46e8872c00294570b6f9beecbcffa034 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250109 21:10:52.718930 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e8872c00294570b6f9beecbcffa034. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.719229 22919 tablet_service.cc:1467] Processing CreateTablet for tablet f1ba1f1f4b844cbeafa6098ff5b3a7ce (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 291184216 <= VALUES < 327582243
I20250109 21:10:52.720556 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ba1f1f4b844cbeafa6098ff5b3a7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.715986 23070 tablet_service.cc:1467] Processing CreateTablet for tablet 414f03400b5e43529a493c039a7b7024 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250109 21:10:52.724009 22918 tablet_service.cc:1467] Processing CreateTablet for tablet 35a60ca37e934a699afc4cea1348eeb6 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250109 21:10:52.724140 22923 tablet_service.cc:1467] Processing CreateTablet for tablet f7fab26983594ff9be82f13812a1e49f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250109 21:10:52.725381 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a60ca37e934a699afc4cea1348eeb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.725863 22922 tablet_service.cc:1467] Processing CreateTablet for tablet e7713f12f4e14c9dbf2c0c02c601fec8 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250109 21:10:52.727082 22917 tablet_service.cc:1467] Processing CreateTablet for tablet f77b5e306c7d4f8884ceab7a4fd81b55 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250109 21:10:52.728914 22916 tablet_service.cc:1467] Processing CreateTablet for tablet ed33dab38b804fefb73e51dca12d3867 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250109 21:10:52.730738 23073 tablet_service.cc:1467] Processing CreateTablet for tablet f7fab26983594ff9be82f13812a1e49f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250109 21:10:52.732631 23072 tablet_service.cc:1467] Processing CreateTablet for tablet e7713f12f4e14c9dbf2c0c02c601fec8 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 145592108 <= VALUES < 181990135
I20250109 21:10:52.734493 23074 tablet_service.cc:1467] Processing CreateTablet for tablet 1a650b5afdf747e5b2efa98da645c5ed (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250109 21:10:52.736312 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7713f12f4e14c9dbf2c0c02c601fec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.689014 22999 tablet_service.cc:1467] Processing CreateTablet for tablet 1a650b5afdf747e5b2efa98da645c5ed (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 36398027 <= VALUES < 72796054
I20250109 21:10:52.738081 22999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a650b5afdf747e5b2efa98da645c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.738533 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77b5e306c7d4f8884ceab7a4fd81b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.740592 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed33dab38b804fefb73e51dca12d3867. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.724045 22921 tablet_service.cc:1467] Processing CreateTablet for tablet 39ae691cd7d54ac7b9e143a80bff4799 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250109 21:10:52.744272 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ae691cd7d54ac7b9e143a80bff4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.690074 22998 tablet_service.cc:1467] Processing CreateTablet for tablet a6503cd8bad54600a24017cfeed153d1 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250109 21:10:52.747715 22998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6503cd8bad54600a24017cfeed153d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.751758 23075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fde04e5e5c34372a88503ab457cda0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.753832 23074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1a650b5afdf747e5b2efa98da645c5ed. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.754987 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414f03400b5e43529a493c039a7b7024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.757086 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f1ba1f1f4b844cbeafa6098ff5b3a7ce. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.758719 22925 tablet_service.cc:1467] Processing CreateTablet for tablet 11f80cf1724045a18b8e19fcc3e57c5f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250109 21:10:52.759968 22925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f80cf1724045a18b8e19fcc3e57c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.760440 22993 tablet_service.cc:1467] Processing CreateTablet for tablet 35a60ca37e934a699afc4cea1348eeb6 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250109 21:10:52.761674 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a60ca37e934a699afc4cea1348eeb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.762009 22924 tablet_service.cc:1467] Processing CreateTablet for tablet c6bf7b2897e84ca68fca53cc84d8a95b (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250109 21:10:52.763227 22924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bf7b2897e84ca68fca53cc84d8a95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.764411 22992 tablet_service.cc:1467] Processing CreateTablet for tablet 5d34599026c142fb83163497006fbfb5 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250109 21:10:52.765012 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fab26983594ff9be82f13812a1e49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.765815 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34599026c142fb83163497006fbfb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.768105 23071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e8872c00294570b6f9beecbcffa034. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.768412 23068 tablet_service.cc:1467] Processing CreateTablet for tablet f77b5e306c7d4f8884ceab7a4fd81b55 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250109 21:10:52.769723 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77b5e306c7d4f8884ceab7a4fd81b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.770047 23067 tablet_service.cc:1467] Processing CreateTablet for tablet 5d34599026c142fb83163497006fbfb5 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250109 21:10:52.773726 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34599026c142fb83163497006fbfb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.773968 23203 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:52.775210 23072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7713f12f4e14c9dbf2c0c02c601fec8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.769348 22922 tablet_service.cc:1467] Processing CreateTablet for tablet e6afbf946f284e519b91063ad62d781a (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250109 21:10:52.776721 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6afbf946f284e519b91063ad62d781a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.788427 23066 tablet_service.cc:1467] Processing CreateTablet for tablet ed33dab38b804fefb73e51dca12d3867 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250109 21:10:52.789814 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed33dab38b804fefb73e51dca12d3867. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.804775 23203 tablet_bootstrap.cc:654] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:52.808343 22991 tablet_service.cc:1467] Processing CreateTablet for tablet ed33dab38b804fefb73e51dca12d3867 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 436776324 <= VALUES < 473174351
I20250109 21:10:52.813936 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ed33dab38b804fefb73e51dca12d3867. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.829780 23150 tablet_service.cc:1467] Processing CreateTablet for tablet 3fde04e5e5c34372a88503ab457cda0e (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION VALUES < 36398027
I20250109 21:10:52.831198 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3fde04e5e5c34372a88503ab457cda0e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.835589 22923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fab26983594ff9be82f13812a1e49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.836128 23149 tablet_service.cc:1467] Processing CreateTablet for tablet a6503cd8bad54600a24017cfeed153d1 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 72796054 <= VALUES < 109194081
I20250109 21:10:52.837433 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet a6503cd8bad54600a24017cfeed153d1. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.849174 23148 tablet_service.cc:1467] Processing CreateTablet for tablet f7fab26983594ff9be82f13812a1e49f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 109194081 <= VALUES < 145592108
I20250109 21:10:52.850580 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f7fab26983594ff9be82f13812a1e49f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.851989 23147 tablet_service.cc:1467] Processing CreateTablet for tablet 39ae691cd7d54ac7b9e143a80bff4799 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 181990135 <= VALUES < 218388162
I20250109 21:10:52.852960 22920 tablet_service.cc:1467] Processing CreateTablet for tablet 5ebf49030ef4421098214f70740e598f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250109 21:10:52.854231 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ebf49030ef4421098214f70740e598f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.854125 23146 tablet_service.cc:1467] Processing CreateTablet for tablet 46e8872c00294570b6f9beecbcffa034 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 218388162 <= VALUES < 254786189
I20250109 21:10:52.855988 23145 tablet_service.cc:1467] Processing CreateTablet for tablet 414f03400b5e43529a493c039a7b7024 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 254786189 <= VALUES < 291184216
I20250109 21:10:52.858031 23144 tablet_service.cc:1467] Processing CreateTablet for tablet 35a60ca37e934a699afc4cea1348eeb6 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 327582243 <= VALUES < 363980270
I20250109 21:10:52.860107 23143 tablet_service.cc:1467] Processing CreateTablet for tablet f77b5e306c7d4f8884ceab7a4fd81b55 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 363980270 <= VALUES < 400378297
I20250109 21:10:52.865278 23142 tablet_service.cc:1467] Processing CreateTablet for tablet 5d34599026c142fb83163497006fbfb5 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 400378297 <= VALUES < 436776324
I20250109 21:10:52.865278 23141 tablet_service.cc:1467] Processing CreateTablet for tablet c6bf7b2897e84ca68fca53cc84d8a95b (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250109 21:10:52.876487 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 35a60ca37e934a699afc4cea1348eeb6. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.878095 22994 tablet_service.cc:1467] Processing CreateTablet for tablet 5ebf49030ef4421098214f70740e598f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250109 21:10:52.879877 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f77b5e306c7d4f8884ceab7a4fd81b55. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.883597 23069 tablet_service.cc:1467] Processing CreateTablet for tablet 11f80cf1724045a18b8e19fcc3e57c5f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250109 21:10:52.884936 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f80cf1724045a18b8e19fcc3e57c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.891279 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 414f03400b5e43529a493c039a7b7024. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.895236 23142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d34599026c142fb83163497006fbfb5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.896203 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 46e8872c00294570b6f9beecbcffa034. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.899235 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39ae691cd7d54ac7b9e143a80bff4799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.903334 23141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bf7b2897e84ca68fca53cc84d8a95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.903512 22996 tablet_service.cc:1467] Processing CreateTablet for tablet 19866aa90bdd4d5e91b1ac29ae31743f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250109 21:10:52.909129 22924 tablet_service.cc:1467] Processing CreateTablet for tablet 575f5547ec354edc8ac999aec2222318 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250109 21:10:52.910421 22924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575f5547ec354edc8ac999aec2222318. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.912320 23073 tablet_service.cc:1467] Processing CreateTablet for tablet 19866aa90bdd4d5e91b1ac29ae31743f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250109 21:10:52.912865 22921 tablet_service.cc:1467] Processing CreateTablet for tablet 436eb85c9e1e4c93afaa8e19215808a8 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250109 21:10:52.913894 22919 tablet_service.cc:1467] Processing CreateTablet for tablet fcdcdd56a86d4793892b6a99883be239 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250109 21:10:52.915114 22922 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4b07d8e80744b782d3fb265f1d0ca7 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250109 21:10:52.917033 22917 tablet_service.cc:1467] Processing CreateTablet for tablet 1df676409e0c4c1ca1dc047d238e4a14 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250109 21:10:52.863340 22993 tablet_service.cc:1467] Processing CreateTablet for tablet c6bf7b2897e84ca68fca53cc84d8a95b (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 473174351 <= VALUES < 509572378
I20250109 21:10:52.927465 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ebf49030ef4421098214f70740e598f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.936034 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19866aa90bdd4d5e91b1ac29ae31743f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.936496 22998 tablet_service.cc:1467] Processing CreateTablet for tablet e6afbf946f284e519b91063ad62d781a (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250109 21:10:52.941001 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdcdd56a86d4793892b6a99883be239. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.949940 23000 tablet_service.cc:1467] Processing CreateTablet for tablet 5b7026bf15ee44938af84fc1397872aa (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250109 21:10:52.968992 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c6bf7b2897e84ca68fca53cc84d8a95b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.967785 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4b07d8e80744b782d3fb265f1d0ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.973063 23069 tablet_service.cc:1467] Processing CreateTablet for tablet 575f5547ec354edc8ac999aec2222318 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250109 21:10:52.974078 23075 tablet_service.cc:1467] Processing CreateTablet for tablet 5b7026bf15ee44938af84fc1397872aa (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250109 21:10:52.985632 23075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7026bf15ee44938af84fc1397872aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.987126 22999 tablet_service.cc:1467] Processing CreateTablet for tablet fcdcdd56a86d4793892b6a99883be239 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250109 21:10:52.974591 22918 tablet_service.cc:1467] Processing CreateTablet for tablet ec0202de32424df98541f334960f7fe2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250109 21:10:52.975358 23202 tablet_bootstrap.cc:492] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:52.975693 23070 tablet_service.cc:1467] Processing CreateTablet for tablet fcdcdd56a86d4793892b6a99883be239 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 727960540 <= VALUES < 764358567
I20250109 21:10:52.976650 23072 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4b07d8e80744b782d3fb265f1d0ca7 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250109 21:10:52.980212 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436eb85c9e1e4c93afaa8e19215808a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:52.983109 23074 tablet_service.cc:1467] Processing CreateTablet for tablet 2eaeb5702b8c4c15a530b7f4bc0b1990 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250109 21:10:52.989454 22997 tablet_service.cc:1467] Processing CreateTablet for tablet 436eb85c9e1e4c93afaa8e19215808a8 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250109 21:10:52.990670 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdcdd56a86d4793892b6a99883be239. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:52.992296 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:52.992655 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0202de32424df98541f334960f7fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.001986 22995 tablet_service.cc:1467] Processing CreateTablet for tablet ec0202de32424df98541f334960f7fe2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250109 21:10:52.993968 22992 tablet_service.cc:1467] Processing CreateTablet for tablet 2eaeb5702b8c4c15a530b7f4bc0b1990 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250109 21:10:53.004606 23204 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:52.989634 23203 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:53.007802 23203 ts_tablet_manager.cc:1397] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.234s user 0.005s sys 0.018s
I20250109 21:10:52.996326 22991 tablet_service.cc:1467] Processing CreateTablet for tablet 1df676409e0c4c1ca1dc047d238e4a14 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250109 21:10:53.008941 23067 tablet_service.cc:1467] Processing CreateTablet for tablet e6afbf946f284e519b91063ad62d781a (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 582368432 <= VALUES < 618766459
I20250109 21:10:53.000326 22916 tablet_service.cc:1467] Processing CreateTablet for tablet d63c66a4270c48cbb4a02ccefda3d871 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250109 21:10:53.010684 23203 raft_consensus.cc:357] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.020293 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63c66a4270c48cbb4a02ccefda3d871. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.020584 23071 tablet_service.cc:1467] Processing CreateTablet for tablet d63c66a4270c48cbb4a02ccefda3d871 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250109 21:10:53.020591 23203 raft_consensus.cc:383] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:53.021638 23203 raft_consensus.cc:738] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:53.022266 22999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fcdcdd56a86d4793892b6a99883be239. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.023227 22998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6afbf946f284e519b91063ad62d781a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.023789 22997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436eb85c9e1e4c93afaa8e19215808a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.023881 23203 consensus_queue.cc:260] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.027195 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df676409e0c4c1ca1dc047d238e4a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.027797 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19866aa90bdd4d5e91b1ac29ae31743f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.028384 23150 tablet_service.cc:1467] Processing CreateTablet for tablet 11f80cf1724045a18b8e19fcc3e57c5f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 509572378 <= VALUES < 545970405
I20250109 21:10:53.029615 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 11f80cf1724045a18b8e19fcc3e57c5f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.034900 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df676409e0c4c1ca1dc047d238e4a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.036149 23149 tablet_service.cc:1467] Processing CreateTablet for tablet 19866aa90bdd4d5e91b1ac29ae31743f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 545970405 <= VALUES < 582368432
I20250109 21:10:53.036841 23144 tablet_service.cc:1467] Processing CreateTablet for tablet 436eb85c9e1e4c93afaa8e19215808a8 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 764358567 <= VALUES < 800756594
I20250109 21:10:53.037400 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 19866aa90bdd4d5e91b1ac29ae31743f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.038048 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 436eb85c9e1e4c93afaa8e19215808a8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.040195 23072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4b07d8e80744b782d3fb265f1d0ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.041378 23000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7026bf15ee44938af84fc1397872aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.042788 23141 tablet_service.cc:1467] Processing CreateTablet for tablet 5ebf49030ef4421098214f70740e598f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 618766459 <= VALUES < 655164486
I20250109 21:10:53.043665 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaeb5702b8c4c15a530b7f4bc0b1990. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.044844 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0202de32424df98541f334960f7fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.046794 23141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5ebf49030ef4421098214f70740e598f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.006780 23066 tablet_service.cc:1467] Processing CreateTablet for tablet 1df676409e0c4c1ca1dc047d238e4a14 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 873552648 <= VALUES < 909950675
I20250109 21:10:53.047195 23071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63c66a4270c48cbb4a02ccefda3d871. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.055215 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e6afbf946f284e519b91063ad62d781a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.070013 23202 tablet_bootstrap.cc:654] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.072146 23203 ts_tablet_manager.cc:1428] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.064s user 0.002s sys 0.007s
I20250109 21:10:53.072939 22960 heartbeater.cc:502] Master 127.19.136.254:39877 was elected leader, sending a full tablet report...
I20250109 21:10:53.058373 23146 tablet_service.cc:1467] Processing CreateTablet for tablet 575f5547ec354edc8ac999aec2222318 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 655164486 <= VALUES < 691562513
I20250109 21:10:53.081496 23068 tablet_service.cc:1467] Processing CreateTablet for tablet cbb4bf7d44374f9d9d8dffad767ec200 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250109 21:10:53.087347 23203 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:53.097257 23074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaeb5702b8c4c15a530b7f4bc0b1990. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.097919 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb4bf7d44374f9d9d8dffad767ec200. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.099189 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1df676409e0c4c1ca1dc047d238e4a14. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.101616 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575f5547ec354edc8ac999aec2222318. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.103582 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 575f5547ec354edc8ac999aec2222318. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.107327 23143 tablet_service.cc:1467] Processing CreateTablet for tablet 5b7026bf15ee44938af84fc1397872aa (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 691562513 <= VALUES < 727960540
I20250109 21:10:53.108731 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5b7026bf15ee44938af84fc1397872aa. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.113319 23203 tablet_bootstrap.cc:654] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.114032 23204 tablet_bootstrap.cc:654] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.118094 23206 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:53.119633 23142 tablet_service.cc:1467] Processing CreateTablet for tablet 4b4b07d8e80744b782d3fb265f1d0ca7 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 800756594 <= VALUES < 837154621
I20250109 21:10:53.120982 23142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b4b07d8e80744b782d3fb265f1d0ca7. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.124641 23206 tablet_bootstrap.cc:654] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.124394 23000 tablet_service.cc:1467] Processing CreateTablet for tablet cbb4bf7d44374f9d9d8dffad767ec200 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250109 21:10:53.125022 23145 tablet_service.cc:1467] Processing CreateTablet for tablet 2eaeb5702b8c4c15a530b7f4bc0b1990 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 837154621 <= VALUES < 873552648
I20250109 21:10:53.138933 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2eaeb5702b8c4c15a530b7f4bc0b1990. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.128883 23148 tablet_service.cc:1467] Processing CreateTablet for tablet ec0202de32424df98541f334960f7fe2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 909950675 <= VALUES < 946348702
I20250109 21:10:53.138005 23000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb4bf7d44374f9d9d8dffad767ec200. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.142977 22919 tablet_service.cc:1467] Processing CreateTablet for tablet ef674a6d97ef453288aac671f539707c (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250109 21:10:53.188480 23207 raft_consensus.cc:491] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:53.188999 23207 raft_consensus.cc:513] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.191318 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef674a6d97ef453288aac671f539707c. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:53.155135 22961 tablet.cc:2367] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250109 21:10:53.194901 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ec0202de32424df98541f334960f7fe2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.201225 23147 tablet_service.cc:1467] Processing CreateTablet for tablet d63c66a4270c48cbb4a02ccefda3d871 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 946348702 <= VALUES < 982746729
I20250109 21:10:53.217830 23207 leader_election.cc:290] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:53.215159 23070 tablet_service.cc:1467] Processing CreateTablet for tablet ef674a6d97ef453288aac671f539707c (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250109 21:10:53.232141 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef674a6d97ef453288aac671f539707c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.232003 23141 tablet_service.cc:1467] Processing CreateTablet for tablet cbb4bf7d44374f9d9d8dffad767ec200 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 982746729 <= VALUES < 1019144756
I20250109 21:10:53.236404 23202 tablet_bootstrap.cc:492] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:53.236267 22918 tablet_service.cc:1467] Processing CreateTablet for tablet e27c19622df5416eb965291aeb863154 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250109 21:10:53.236979 23202 ts_tablet_manager.cc:1397] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.262s user 0.031s sys 0.033s
I20250109 21:10:53.237977 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c19622df5416eb965291aeb863154. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.247915 23202 raft_consensus.cc:357] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.248730 23202 raft_consensus.cc:383] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:53.249030 23202 raft_consensus.cc:738] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:53.249796 23202 consensus_queue.cc:260] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.259341 22924 tablet_service.cc:1467] Processing CreateTablet for tablet fe0ebd1c0ccc476b9d29f49ee9429849 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250109 21:10:53.260706 22924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0ebd1c0ccc476b9d29f49ee9429849. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.262652 23036 heartbeater.cc:502] Master 127.19.136.254:39877 was elected leader, sending a full tablet report...
I20250109 21:10:53.272754 23203 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:53.273433 23203 ts_tablet_manager.cc:1397] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.186s user 0.012s sys 0.015s
I20250109 21:10:53.277070 23203 raft_consensus.cc:357] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:53.278033 23203 raft_consensus.cc:383] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:53.278414 23203 raft_consensus.cc:738] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:53.218751 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d63c66a4270c48cbb4a02ccefda3d871. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.279268 23203 consensus_queue.cc:260] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:53.273458 23150 tablet_service.cc:1467] Processing CreateTablet for tablet e27c19622df5416eb965291aeb863154 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250109 21:10:53.282161 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c19622df5416eb965291aeb863154. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.285668 22921 tablet_service.cc:1467] Processing CreateTablet for tablet 599de49040a74fba9b64f8f5cd31e376 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250109 21:10:53.286984 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599de49040a74fba9b64f8f5cd31e376. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.292557 23203 ts_tablet_manager.cc:1428] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.019s user 0.007s sys 0.000s
I20250109 21:10:53.293678 23203 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:53.300012 23144 tablet_service.cc:1467] Processing CreateTablet for tablet fe0ebd1c0ccc476b9d29f49ee9429849 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250109 21:10:53.301128 23203 tablet_bootstrap.cc:654] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.301298 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0ebd1c0ccc476b9d29f49ee9429849. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.301563 23145 tablet_service.cc:1467] Processing CreateTablet for tablet c680a42bcf4d467a9cf94539658db79b (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250109 21:10:53.312288 23204 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:53.312870 23204 ts_tablet_manager.cc:1397] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.309s user 0.011s sys 0.013s
I20250109 21:10:53.306633 23142 tablet_service.cc:1467] Processing CreateTablet for tablet d316cfec4ecf4f989132abc75c89a161 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250109 21:10:53.302800 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680a42bcf4d467a9cf94539658db79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.339850 22922 tablet_service.cc:1467] Processing CreateTablet for tablet d316cfec4ecf4f989132abc75c89a161 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250109 21:10:53.341181 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d316cfec4ecf4f989132abc75c89a161. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.344520 23149 tablet_service.cc:1467] Processing CreateTablet for tablet eb61d520b2e04186b48e156c321b7a87 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250109 21:10:53.345788 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb61d520b2e04186b48e156c321b7a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.346781 23111 heartbeater.cc:502] Master 127.19.136.254:39877 was elected leader, sending a full tablet report...
W20250109 21:10:53.347254 22818 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 131435us
W20250109 21:10:53.357502 22819 outbound_call.cc:321] RPC callback for RPC call kudu.tserver.TabletServerAdminService.CreateTablet -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 137273us
I20250109 21:10:53.364626 23071 tablet_service.cc:1467] Processing CreateTablet for tablet eb61d520b2e04186b48e156c321b7a87 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250109 21:10:53.364950 23072 tablet_service.cc:1467] Processing CreateTablet for tablet c680a42bcf4d467a9cf94539658db79b (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250109 21:10:53.366271 23071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb61d520b2e04186b48e156c321b7a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.379648 22997 tablet_service.cc:1467] Processing CreateTablet for tablet c680a42bcf4d467a9cf94539658db79b (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1128338837 <= VALUES < 1164736864
I20250109 21:10:53.381202 22997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680a42bcf4d467a9cf94539658db79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.382579 22999 tablet_service.cc:1467] Processing CreateTablet for tablet 599de49040a74fba9b64f8f5cd31e376 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250109 21:10:53.384016 22999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599de49040a74fba9b64f8f5cd31e376. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.386449 23067 tablet_service.cc:1467] Processing CreateTablet for tablet 0c859bd141e74dbd810b500fd5244d26 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250109 21:10:53.384521 22995 tablet_service.cc:1467] Processing CreateTablet for tablet ef674a6d97ef453288aac671f539707c (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1019144756 <= VALUES < 1055542783
I20250109 21:10:53.387856 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c859bd141e74dbd810b500fd5244d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.388659 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ef674a6d97ef453288aac671f539707c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.400460 23142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d316cfec4ecf4f989132abc75c89a161. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.371724 23066 tablet_service.cc:1467] Processing CreateTablet for tablet 599de49040a74fba9b64f8f5cd31e376 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1164736864 <= VALUES < 1201134891
I20250109 21:10:53.407197 23150 tablet_service.cc:1467] Processing CreateTablet for tablet 0c859bd141e74dbd810b500fd5244d26 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250109 21:10:53.409066 22994 tablet_service.cc:1467] Processing CreateTablet for tablet d316cfec4ecf4f989132abc75c89a161 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1201134891 <= VALUES < 1237532918
I20250109 21:10:53.410274 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d316cfec4ecf4f989132abc75c89a161. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.411646 23072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c680a42bcf4d467a9cf94539658db79b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.413746 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 599de49040a74fba9b64f8f5cd31e376. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.401922 23141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbb4bf7d44374f9d9d8dffad767ec200. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.415200 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c859bd141e74dbd810b500fd5244d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.419624 23204 raft_consensus.cc:357] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.420393 23204 raft_consensus.cc:383] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:53.420670 23204 raft_consensus.cc:738] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:53.421350 23204 consensus_queue.cc:260] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.425585 23202 ts_tablet_manager.cc:1428] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.188s user 0.006s sys 0.006s
I20250109 21:10:53.428326 22998 tablet_service.cc:1467] Processing CreateTablet for tablet 0c859bd141e74dbd810b500fd5244d26 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1273930945 <= VALUES < 1310328972
I20250109 21:10:53.429636 22998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 0c859bd141e74dbd810b500fd5244d26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.436532 22921 tablet_service.cc:1467] Processing CreateTablet for tablet 9657cd13da7346f3bc0bbe9be4cd54da (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250109 21:10:53.437808 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9657cd13da7346f3bc0bbe9be4cd54da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.438091 23068 tablet_service.cc:1467] Processing CreateTablet for tablet 125b38b701634accb2448016a89bc27f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250109 21:10:53.439198 23185 heartbeater.cc:502] Master 127.19.136.254:39877 was elected leader, sending a full tablet report...
I20250109 21:10:53.442942 23070 tablet_service.cc:1467] Processing CreateTablet for tablet e4f32bf225644269afca55cb6491e09a (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250109 21:10:53.445796 22924 tablet_service.cc:1467] Processing CreateTablet for tablet 7ea2612c1c6e4ee6b27cc5626e5fc981 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250109 21:10:53.447857 22924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea2612c1c6e4ee6b27cc5626e5fc981. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.452344 23206 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:53.453692 23206 ts_tablet_manager.cc:1397] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.336s user 0.013s sys 0.005s
I20250109 21:10:53.454610 23202 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:53.456221 23206 raft_consensus.cc:357] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:53.456378 22992 tablet_service.cc:1467] Processing CreateTablet for tablet 125b38b701634accb2448016a89bc27f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250109 21:10:53.456653 22991 tablet_service.cc:1467] Processing CreateTablet for tablet 9657cd13da7346f3bc0bbe9be4cd54da (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250109 21:10:53.456893 22996 tablet_service.cc:1467] Processing CreateTablet for tablet e4f32bf225644269afca55cb6491e09a (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250109 21:10:53.458621 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9657cd13da7346f3bc0bbe9be4cd54da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.459364 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f32bf225644269afca55cb6491e09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.459928 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125b38b701634accb2448016a89bc27f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.467135 22919 tablet_service.cc:1467] Processing CreateTablet for tablet 125b38b701634accb2448016a89bc27f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1310328972 <= VALUES < 1346726999
I20250109 21:10:53.468492 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125b38b701634accb2448016a89bc27f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.480182 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f32bf225644269afca55cb6491e09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.480647 23146 tablet_service.cc:1467] Processing CreateTablet for tablet 7ea2612c1c6e4ee6b27cc5626e5fc981 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250109 21:10:53.481032 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:53.482334 22918 tablet_service.cc:1467] Processing CreateTablet for tablet c762018d1be74ce190b41ebd28a2e93e (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250109 21:10:53.483594 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c762018d1be74ce190b41ebd28a2e93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.485373 23207 raft_consensus.cc:491] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:53.485854 23207 raft_consensus.cc:513] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:10:53.487874 22900 leader_election.cc:343] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:53.488068 23207 leader_election.cc:290] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:53.488819 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 125b38b701634accb2448016a89bc27f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.488984 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea2612c1c6e4ee6b27cc5626e5fc981. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.496830 23073 tablet_service.cc:1467] Processing CreateTablet for tablet c762018d1be74ce190b41ebd28a2e93e (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250109 21:10:53.498086 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c762018d1be74ce190b41ebd28a2e93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.503829 22999 tablet_service.cc:1467] Processing CreateTablet for tablet c762018d1be74ce190b41ebd28a2e93e (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1455921080 <= VALUES < 1492319107
I20250109 21:10:53.505100 22999 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c762018d1be74ce190b41ebd28a2e93e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.457027 23206 raft_consensus.cc:383] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:53.513592 22993 tablet_service.cc:1467] Processing CreateTablet for tablet e27c19622df5416eb965291aeb863154 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1055542783 <= VALUES < 1091940810
I20250109 21:10:53.509558 23206 raft_consensus.cc:738] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:53.518558 23206 consensus_queue.cc:260] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:53.519413 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:53.518752 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:53.525161 23203 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:53.525715 23203 ts_tablet_manager.cc:1397] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.232s user 0.021s sys 0.005s
I20250109 21:10:53.531563 23203 raft_consensus.cc:357] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.535374 22916 tablet_service.cc:1467] Processing CreateTablet for tablet c8e82f7c977e4539b1368607513bc151 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250109 21:10:53.541767 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e82f7c977e4539b1368607513bc151. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.543956 23143 tablet_service.cc:1467] Processing CreateTablet for tablet c8e82f7c977e4539b1368607513bc151 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250109 21:10:53.545241 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e82f7c977e4539b1368607513bc151. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.547457 23069 tablet_service.cc:1467] Processing CreateTablet for tablet 7ea2612c1c6e4ee6b27cc5626e5fc981 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1383125026 <= VALUES < 1419523053
I20250109 21:10:53.536288 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e27c19622df5416eb965291aeb863154. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.548745 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7ea2612c1c6e4ee6b27cc5626e5fc981. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:53.550696 22899 leader_election.cc:343] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:53.551590 22899 leader_election.cc:343] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:53.551887 23075 tablet_service.cc:1467] Processing CreateTablet for tablet fe0ebd1c0ccc476b9d29f49ee9429849 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1091940810 <= VALUES < 1128338837
I20250109 21:10:53.553233 23075 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fe0ebd1c0ccc476b9d29f49ee9429849. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.552104 22899 leader_election.cc:304] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:53.556918 23207 raft_consensus.cc:2743] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:53.549907 23203 raft_consensus.cc:383] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:53.558562 23203 raft_consensus.cc:738] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:53.567905 23203 consensus_queue.cc:260] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.540380 23148 tablet_service.cc:1467] Processing CreateTablet for tablet e4f32bf225644269afca55cb6491e09a (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1419523053 <= VALUES < 1455921080
I20250109 21:10:53.569725 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e4f32bf225644269afca55cb6491e09a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.573043 23203 ts_tablet_manager.cc:1428] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.047s user 0.007s sys 0.000s
I20250109 21:10:53.607733 23203 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:53.573211 23204 ts_tablet_manager.cc:1428] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.260s user 0.010s sys 0.006s
I20250109 21:10:53.573289 23000 tablet_service.cc:1467] Processing CreateTablet for tablet c8e82f7c977e4539b1368607513bc151 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1492319107 <= VALUES < 1528717134
I20250109 21:10:53.573734 22917 tablet_service.cc:1467] Processing CreateTablet for tablet eb61d520b2e04186b48e156c321b7a87 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1237532918 <= VALUES < 1273930945
I20250109 21:10:53.622612 23204 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:53.622802 22917 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet eb61d520b2e04186b48e156c321b7a87. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.574119 23071 tablet_service.cc:1467] Processing CreateTablet for tablet 4309ed0e1fa847329590a19703399802 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250109 21:10:53.627674 23071 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4309ed0e1fa847329590a19703399802. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.577594 23142 tablet_service.cc:1467] Processing CreateTablet for tablet 4309ed0e1fa847329590a19703399802 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250109 21:10:53.631824 23142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4309ed0e1fa847329590a19703399802. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.578687 22924 tablet_service.cc:1467] Processing CreateTablet for tablet 4309ed0e1fa847329590a19703399802 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1528717134 <= VALUES < 1565115161
I20250109 21:10:53.635663 22924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4309ed0e1fa847329590a19703399802. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.584216 23202 tablet_bootstrap.cc:654] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.585192 23207 raft_consensus.cc:491] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:53.595480 22991 tablet_service.cc:1467] Processing CreateTablet for tablet e85cb6e4e45a40ed966b3016f17f0b08 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250109 21:10:53.640435 23207 raft_consensus.cc:513] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.641119 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85cb6e4e45a40ed966b3016f17f0b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.642444 23207 leader_election.cc:290] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:53.596124 23074 tablet_service.cc:1467] Processing CreateTablet for tablet e85cb6e4e45a40ed966b3016f17f0b08 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250109 21:10:53.643227 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:53.644120 23074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85cb6e4e45a40ed966b3016f17f0b08. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:53.644680 22899 leader_election.cc:343] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:53.602618 22994 tablet_service.cc:1467] Processing CreateTablet for tablet 4b8f3a239a93458eab441de7a47bf286 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250109 21:10:53.647243 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:53.647644 22994 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8f3a239a93458eab441de7a47bf286. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.647904 23085 raft_consensus.cc:2463] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:53.649060 22900 leader_election.cc:304] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:53.650215 23207 raft_consensus.cc:2798] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:53.650597 23207 raft_consensus.cc:491] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:53.650929 23207 raft_consensus.cc:3054] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:53.653872 23215 raft_consensus.cc:491] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:53.654352 23215 raft_consensus.cc:513] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.655566 23000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c8e82f7c977e4539b1368607513bc151. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.603504 23147 tablet_service.cc:1467] Processing CreateTablet for tablet 9657cd13da7346f3bc0bbe9be4cd54da (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1346726999 <= VALUES < 1383125026
I20250109 21:10:53.605512 23144 tablet_service.cc:1467] Processing CreateTablet for tablet e85cb6e4e45a40ed966b3016f17f0b08 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1565115161 <= VALUES < 1601513188
I20250109 21:10:53.612812 23206 ts_tablet_manager.cc:1428] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.159s user 0.006s sys 0.003s
I20250109 21:10:53.613776 22921 tablet_service.cc:1467] Processing CreateTablet for tablet be8d475138234afd9334c27a5ef7b9ef (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250109 21:10:53.656777 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 9657cd13da7346f3bc0bbe9be4cd54da. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.657179 22921 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8d475138234afd9334c27a5ef7b9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.616892 23149 tablet_service.cc:1467] Processing CreateTablet for tablet b099b1062f574cac8c7d6ea4b425d639 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250109 21:10:53.614066 22918 tablet_service.cc:1467] Processing CreateTablet for tablet 4b8f3a239a93458eab441de7a47bf286 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250109 21:10:53.655781 23203 tablet_bootstrap.cc:654] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.618546 23066 tablet_service.cc:1467] Processing CreateTablet for tablet 4b8f3a239a93458eab441de7a47bf286 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1601513188 <= VALUES < 1637911215
I20250109 21:10:53.665828 23206 tablet_bootstrap.cc:492] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:53.659775 23215 leader_election.cc:290] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:53.690080 22916 tablet_service.cc:1467] Processing CreateTablet for tablet b099b1062f574cac8c7d6ea4b425d639 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250109 21:10:53.691227 23204 tablet_bootstrap.cc:654] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.707850 23146 tablet_service.cc:1467] Processing CreateTablet for tablet 1700a41cd4c54a0d8b7e2e23d22f18a5 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250109 21:10:53.710003 23066 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8f3a239a93458eab441de7a47bf286. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.710510 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:53.711730 23202 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:53.711442 22993 tablet_service.cc:1467] Processing CreateTablet for tablet be8d475138234afd9334c27a5ef7b9ef (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250109 21:10:53.712218 23202 ts_tablet_manager.cc:1397] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.258s user 0.019s sys 0.012s
I20250109 21:10:53.712725 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8d475138234afd9334c27a5ef7b9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.712580 23148 tablet_service.cc:1467] Processing CreateTablet for tablet cbd7a89d4ce745659bb16e1e800506ba (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250109 21:10:53.711453 23160 raft_consensus.cc:2463] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:53.714939 23202 raft_consensus.cc:357] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:53.715718 23202 raft_consensus.cc:383] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:53.716017 23202 raft_consensus.cc:738] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:53.716166 22901 leader_election.cc:304] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:53.718196 22918 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4b8f3a239a93458eab441de7a47bf286. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.718892 22922 tablet_service.cc:1467] Processing CreateTablet for tablet cbd7a89d4ce745659bb16e1e800506ba (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250109 21:10:53.720130 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd7a89d4ce745659bb16e1e800506ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.721243 23150 tablet_service.cc:1467] Processing CreateTablet for tablet 90cf2809271744d4a4616db6fc05551f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250109 21:10:53.700634 23144 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e85cb6e4e45a40ed966b3016f17f0b08. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.733707 22916 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b099b1062f574cac8c7d6ea4b425d639. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.737370 23207 raft_consensus.cc:513] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:53.739375 22920 tablet_service.cc:1467] Processing CreateTablet for tablet 90cf2809271744d4a4616db6fc05551f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250109 21:10:53.740077 23149 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b099b1062f574cac8c7d6ea4b425d639. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.740630 22920 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf2809271744d4a4616db6fc05551f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.742187 23068 tablet_service.cc:1467] Processing CreateTablet for tablet 90cf2809271744d4a4616db6fc05551f (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1819901350 <= VALUES < 1856299377
I20250109 21:10:53.743852 23073 tablet_service.cc:1467] Processing CreateTablet for tablet f4a6a46398de4d2f994691863b60ded9 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250109 21:10:53.745201 22925 tablet_service.cc:1467] Processing CreateTablet for tablet 58e256470c0347368a2757ad2e66e833 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250109 21:10:53.698642 22919 tablet_service.cc:1467] Processing CreateTablet for tablet f4a6a46398de4d2f994691863b60ded9 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250109 21:10:53.745554 23067 tablet_service.cc:1467] Processing CreateTablet for tablet b5bdc088c0764e47a32e093893889baf (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250109 21:10:53.746440 22925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e256470c0347368a2757ad2e66e833. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.747467 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf2809271744d4a4616db6fc05551f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.743865 23141 tablet_service.cc:1467] Processing CreateTablet for tablet b5bdc088c0764e47a32e093893889baf (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250109 21:10:53.749727 22919 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a6a46398de4d2f994691863b60ded9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.752182 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a6a46398de4d2f994691863b60ded9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.754547 23143 tablet_service.cc:1467] Processing CreateTablet for tablet be8d475138234afd9334c27a5ef7b9ef (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1637911215 <= VALUES < 1674309242
I20250109 21:10:53.756095 23067 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bdc088c0764e47a32e093893889baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.757467 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd7a89d4ce745659bb16e1e800506ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.761215 23150 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 90cf2809271744d4a4616db6fc05551f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.768179 23206 tablet_bootstrap.cc:654] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:53.769982 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1700a41cd4c54a0d8b7e2e23d22f18a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.779609 23143 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet be8d475138234afd9334c27a5ef7b9ef. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.783389 23141 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bdc088c0764e47a32e093893889baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.797712 23145 tablet_service.cc:1467] Processing CreateTablet for tablet 2732f8eccc4e4e6499255672a626b4a2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250109 21:10:53.798148 23072 tablet_service.cc:1467] Processing CreateTablet for tablet b099b1062f574cac8c7d6ea4b425d639 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1674309242 <= VALUES < 1710707269
I20250109 21:10:53.799106 23145 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2732f8eccc4e4e6499255672a626b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.799690 23072 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b099b1062f574cac8c7d6ea4b425d639. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.774467 23202 consensus_queue.cc:260] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:53.804620 23070 tablet_service.cc:1467] Processing CreateTablet for tablet 58e256470c0347368a2757ad2e66e833 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250109 21:10:53.818598 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e256470c0347368a2757ad2e66e833. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.819605 22923 tablet_service.cc:1467] Processing CreateTablet for tablet 2732f8eccc4e4e6499255672a626b4a2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250109 21:10:53.820931 22923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2732f8eccc4e4e6499255672a626b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.826041 23074 tablet_service.cc:1467] Processing CreateTablet for tablet f43fbf50f6a242cc91616f51d41df9b2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250109 21:10:53.827428 23074 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43fbf50f6a242cc91616f51d41df9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.846441 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:53.848752 23085 raft_consensus.cc:3054] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:53.852954 23142 tablet_service.cc:1467] Processing CreateTablet for tablet f43fbf50f6a242cc91616f51d41df9b2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250109 21:10:53.854477 23142 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43fbf50f6a242cc91616f51d41df9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.863122 23225 raft_consensus.cc:2798] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:53.863644 23225 raft_consensus.cc:491] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:53.864068 23225 raft_consensus.cc:3054] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:53.843788 23207 leader_election.cc:290] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:53.867084 22922 tablet_service.cc:1467] Processing CreateTablet for tablet f43fbf50f6a242cc91616f51d41df9b2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1965493458 <= VALUES < 2001891485
I20250109 21:10:53.868956 22922 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f43fbf50f6a242cc91616f51d41df9b2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.881126 23069 tablet_service.cc:1467] Processing CreateTablet for tablet 1700a41cd4c54a0d8b7e2e23d22f18a5 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250109 21:10:53.882551 23069 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1700a41cd4c54a0d8b7e2e23d22f18a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.889029 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:53.890631 22976 leader_election.cc:343] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:53.899945 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:53.912932 22924 tablet_service.cc:1467] Processing CreateTablet for tablet fd29e1c05b4a4a5092fada7c6d4e2b21 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250109 21:10:53.914319 22924 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd29e1c05b4a4a5092fada7c6d4e2b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.916410 23000 tablet_service.cc:1467] Processing CreateTablet for tablet 1700a41cd4c54a0d8b7e2e23d22f18a5 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1710707269 <= VALUES < 1747105296
I20250109 21:10:53.916997 22991 tablet_service.cc:1467] Processing CreateTablet for tablet cbd7a89d4ce745659bb16e1e800506ba (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1783503323 <= VALUES < 1819901350
I20250109 21:10:53.917662 23000 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1700a41cd4c54a0d8b7e2e23d22f18a5. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.917238 22996 tablet_service.cc:1467] Processing CreateTablet for tablet b5bdc088c0764e47a32e093893889baf (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1856299377 <= VALUES < 1892697404
I20250109 21:10:53.918335 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet cbd7a89d4ce745659bb16e1e800506ba. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.919304 22992 tablet_service.cc:1467] Processing CreateTablet for tablet 58e256470c0347368a2757ad2e66e833 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1892697404 <= VALUES < 1929095431
I20250109 21:10:53.931322 22996 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b5bdc088c0764e47a32e093893889baf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.931759 23070 tablet_service.cc:1467] Processing CreateTablet for tablet fd29e1c05b4a4a5092fada7c6d4e2b21 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250109 21:10:53.933017 23070 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd29e1c05b4a4a5092fada7c6d4e2b21. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:53.860795 22901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 144894us
I20250109 21:10:53.919418 22997 tablet_service.cc:1467] Processing CreateTablet for tablet f4a6a46398de4d2f994691863b60ded9 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1747105296 <= VALUES < 1783503323
I20250109 21:10:53.935554 23146 tablet_service.cc:1467] Processing CreateTablet for tablet 75760788e49142f3b4fe4024c99a2148 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250109 21:10:53.936398 22998 tablet_service.cc:1467] Processing CreateTablet for tablet 2732f8eccc4e4e6499255672a626b4a2 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 1929095431 <= VALUES < 1965493458
I20250109 21:10:53.936813 23146 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75760788e49142f3b4fe4024c99a2148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.939600 22992 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 58e256470c0347368a2757ad2e66e833. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.960631 22923 tablet_service.cc:1467] Processing CreateTablet for tablet 75760788e49142f3b4fe4024c99a2148 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250109 21:10:53.961961 22923 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75760788e49142f3b4fe4024c99a2148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.961585 22995 tablet_service.cc:1467] Processing CreateTablet for tablet 4c150b5bc7644fcb865799e65af066f3 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250109 21:10:53.973376 22925 tablet_service.cc:1467] Processing CreateTablet for tablet 398bc3fa45cb462e85dc87212af53ec3 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250109 21:10:53.974001 23203 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:53.974529 23203 ts_tablet_manager.cc:1397] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.367s user 0.013s sys 0.009s
I20250109 21:10:53.974650 22925 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398bc3fa45cb462e85dc87212af53ec3. 1 dirs total, 0 dirs full, 0 dirs failed
W20250109 21:10:53.969292 22899 leader_election.cc:343] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:53.978607 23202 ts_tablet_manager.cc:1428] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.266s user 0.007s sys 0.003s
I20250109 21:10:53.981381 22997 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f4a6a46398de4d2f994691863b60ded9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.982035 22995 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c150b5bc7644fcb865799e65af066f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.988199 22998 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2732f8eccc4e4e6499255672a626b4a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:53.997028 23206 tablet_bootstrap.cc:492] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:53.997553 23206 ts_tablet_manager.cc:1397] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.332s user 0.001s sys 0.032s
I20250109 21:10:53.997610 23203 raft_consensus.cc:357] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:53.998423 23203 raft_consensus.cc:383] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.000488 23206 raft_consensus.cc:357] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.002067 23206 raft_consensus.cc:383] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.002404 23206 raft_consensus.cc:738] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
W20250109 21:10:54.003325 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:54.003269 23206 consensus_queue.cc:260] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.004068 23085 raft_consensus.cc:2463] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:54.007172 22900 leader_election.cc:304] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:54.008307 23207 raft_consensus.cc:2798] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.014683 23206 ts_tablet_manager.cc:1428] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.017s user 0.003s sys 0.003s
I20250109 21:10:54.017510 23148 tablet_service.cc:1467] Processing CreateTablet for tablet 398bc3fa45cb462e85dc87212af53ec3 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250109 21:10:54.019589 23206 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:54.020728 23204 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:54.021351 23204 ts_tablet_manager.cc:1397] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.399s user 0.053s sys 0.049s
I20250109 21:10:54.021997 23202 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:54.024325 23204 raft_consensus.cc:357] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.025077 23204 raft_consensus.cc:383] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.025393 23204 raft_consensus.cc:738] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.026206 23204 consensus_queue.cc:260] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.035298 23204 ts_tablet_manager.cc:1428] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.014s user 0.003s sys 0.004s
I20250109 21:10:53.998701 23203 raft_consensus.cc:738] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.044329 23068 tablet_service.cc:1467] Processing CreateTablet for tablet 4c150b5bc7644fcb865799e65af066f3 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250109 21:10:54.045667 23068 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c150b5bc7644fcb865799e65af066f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:54.045547 22993 tablet_service.cc:1467] Processing CreateTablet for tablet fd29e1c05b4a4a5092fada7c6d4e2b21 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2038289512 <= VALUES < 2074687539
I20250109 21:10:54.047080 23147 tablet_service.cc:1467] Processing CreateTablet for tablet 4c150b5bc7644fcb865799e65af066f3 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2001891485 <= VALUES < 2038289512
I20250109 21:10:54.047601 23204 tablet_bootstrap.cc:492] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:54.046836 22993 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet fd29e1c05b4a4a5092fada7c6d4e2b21. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:54.051036 23148 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398bc3fa45cb462e85dc87212af53ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:54.053905 23202 tablet_bootstrap.cc:654] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.058610 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:54.060614 22991 tablet_service.cc:1467] Processing CreateTablet for tablet 75760788e49142f3b4fe4024c99a2148 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2074687539 <= VALUES < 2111085566
I20250109 21:10:54.069111 22991 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 75760788e49142f3b4fe4024c99a2148. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:54.073854 23073 tablet_service.cc:1467] Processing CreateTablet for tablet 398bc3fa45cb462e85dc87212af53ec3 (DEFAULT_TABLE table=test-workload [id=29e3f3ab14da4f96819c46bfc061d17c]), partition=RANGE (key) PARTITION 2111085566 <= VALUES
I20250109 21:10:54.077873 23073 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 398bc3fa45cb462e85dc87212af53ec3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:54.075153 23147 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4c150b5bc7644fcb865799e65af066f3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:10:54.075251 23207 raft_consensus.cc:695] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:54.075632 23203 consensus_queue.cc:260] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.039186 23225 raft_consensus.cc:513] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.065932 23204 tablet_bootstrap.cc:654] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:54.080701 22975 leader_election.cc:343] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.091607 23207 consensus_queue.cc:237] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.100690 23225 leader_election.cc:290] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:54.101486 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:54.102139 23160 raft_consensus.cc:3054] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.103405 23215 raft_consensus.cc:491] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.103911 23215 raft_consensus.cc:513] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.106077 23215 leader_election.cc:290] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:54.107821 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:54.114847 22975 leader_election.cc:304] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
W20250109 21:10:54.141551 22976 leader_election.cc:343] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:54.142057 22975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 61530.1us
I20250109 21:10:54.142736 23203 ts_tablet_manager.cc:1428] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.168s user 0.008s sys 0.016s
I20250109 21:10:54.144047 23215 raft_consensus.cc:2743] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:54.146893 23203 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:54.146728 23160 raft_consensus.cc:2463] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:54.148069 22901 leader_election.cc:304] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:10:54.148978 23229 raft_consensus.cc:2798] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.149453 23229 raft_consensus.cc:695] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:54.142611 23202 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:54.150223 23229 consensus_queue.cc:237] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.154698 23206 tablet_bootstrap.cc:654] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.155812 22830 catalog_manager.cc:5526] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:54.159422 23202 ts_tablet_manager.cc:1397] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.138s user 0.018s sys 0.011s
I20250109 21:10:54.160563 23204 tablet_bootstrap.cc:492] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:54.161307 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:54.174588 23204 ts_tablet_manager.cc:1397] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.127s user 0.015s sys 0.012s
W20250109 21:10:54.175072 22899 leader_election.cc:343] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.184453 23203 tablet_bootstrap.cc:654] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.187676 23204 raft_consensus.cc:357] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.188575 23204 raft_consensus.cc:383] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.188879 23204 raft_consensus.cc:738] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.189668 23204 consensus_queue.cc:260] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.197892 23204 ts_tablet_manager.cc:1428] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.023s user 0.006s sys 0.000s
I20250109 21:10:54.199210 23202 raft_consensus.cc:357] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.199971 23204 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:54.200006 23202 raft_consensus.cc:383] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.202358 23202 raft_consensus.cc:738] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.203115 23202 consensus_queue.cc:260] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.205498 23202 ts_tablet_manager.cc:1428] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20250109 21:10:54.206529 23202 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:54.206586 23204 tablet_bootstrap.cc:654] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.208503 23206 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:54.209031 23206 ts_tablet_manager.cc:1397] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.190s user 0.014s sys 0.014s
I20250109 21:10:54.248984 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.247984 23206 raft_consensus.cc:357] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.254321 23206 raft_consensus.cc:383] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.267289 23203 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:54.268414 23203 ts_tablet_manager.cc:1397] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.122s user 0.016s sys 0.011s
W20250109 21:10:54.269996 22976 leader_election.cc:343] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.271191 22976 leader_election.cc:304] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:54.274252 23203 raft_consensus.cc:357] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.275486 23203 raft_consensus.cc:383] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.275849 23203 raft_consensus.cc:738] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.276953 23203 consensus_queue.cc:260] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.279510 23215 raft_consensus.cc:2743] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:54.255615 23206 raft_consensus.cc:738] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.281565 23203 ts_tablet_manager.cc:1428] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.013s user 0.007s sys 0.003s
I20250109 21:10:54.281998 23206 consensus_queue.cc:260] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.284996 23203 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:54.287212 23202 tablet_bootstrap.cc:654] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.301688 23204 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:54.302621 23204 ts_tablet_manager.cc:1397] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.103s user 0.013s sys 0.021s
I20250109 21:10:54.305220 23203 tablet_bootstrap.cc:654] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.306875 23202 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:54.305325 23206 ts_tablet_manager.cc:1428] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.096s user 0.009s sys 0.004s
I20250109 21:10:54.306571 23204 raft_consensus.cc:357] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.307633 23204 raft_consensus.cc:383] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.308121 23204 raft_consensus.cc:738] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.309242 23204 consensus_queue.cc:260] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.307649 23202 ts_tablet_manager.cc:1397] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.101s user 0.014s sys 0.014s
I20250109 21:10:54.312219 23215 raft_consensus.cc:491] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.312767 23215 raft_consensus.cc:513] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.318384 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:54.314981 23202 raft_consensus.cc:357] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.319295 23202 raft_consensus.cc:383] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.319571 23160 raft_consensus.cc:2388] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:54.319779 23202 raft_consensus.cc:738] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.318606 23206 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:54.321009 23202 consensus_queue.cc:260] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.315059 23215 leader_election.cc:290] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:54.317572 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.317986 23204 ts_tablet_manager.cc:1428] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20250109 21:10:54.324479 22976 leader_election.cc:304] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:54.324941 23204 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:54.328979 23206 tablet_bootstrap.cc:654] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.329618 23215 raft_consensus.cc:3054] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.337831 23202 ts_tablet_manager.cc:1428] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.026s user 0.002s sys 0.007s
I20250109 21:10:54.339783 23202 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:54.346827 23204 tablet_bootstrap.cc:654] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.350286 23202 tablet_bootstrap.cc:654] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.352113 23203 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:54.352649 23203 ts_tablet_manager.cc:1397] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.068s user 0.014s sys 0.014s
I20250109 21:10:54.355506 23203 raft_consensus.cc:357] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.357824 23215 raft_consensus.cc:2743] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:54.359845 23203 raft_consensus.cc:383] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.360678 23203 raft_consensus.cc:738] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.362006 23203 consensus_queue.cc:260] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.362008 22830 catalog_manager.cc:5526] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:54.366086 23204 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:54.366530 23203 ts_tablet_manager.cc:1428] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.014s user 0.010s sys 0.000s
I20250109 21:10:54.368108 23203 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:54.366624 23204 ts_tablet_manager.cc:1397] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.042s user 0.005s sys 0.009s
I20250109 21:10:54.371757 23202 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:54.372542 23202 ts_tablet_manager.cc:1397] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.033s user 0.016s sys 0.009s
I20250109 21:10:54.375523 23206 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:54.375545 23203 tablet_bootstrap.cc:654] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.376142 23206 ts_tablet_manager.cc:1397] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.058s user 0.010s sys 0.004s
I20250109 21:10:54.376605 23202 raft_consensus.cc:357] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.377488 23202 raft_consensus.cc:383] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.377805 23202 raft_consensus.cc:738] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.378659 23202 consensus_queue.cc:260] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.379338 23206 raft_consensus.cc:357] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.380098 23206 raft_consensus.cc:383] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.380426 23206 raft_consensus.cc:738] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.372339 23204 raft_consensus.cc:357] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.381583 23202 ts_tablet_manager.cc:1428] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20250109 21:10:54.382215 23206 consensus_queue.cc:260] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.383086 23202 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:54.381580 23204 raft_consensus.cc:383] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.383507 23204 raft_consensus.cc:738] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.384327 23204 consensus_queue.cc:260] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.387267 23204 ts_tablet_manager.cc:1428] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.018s user 0.007s sys 0.000s
I20250109 21:10:54.388959 23218 raft_consensus.cc:491] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.389533 23218 raft_consensus.cc:513] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.391278 23203 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:54.391786 23203 ts_tablet_manager.cc:1397] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.007s
I20250109 21:10:54.391927 23202 tablet_bootstrap.cc:654] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.392207 23206 ts_tablet_manager.cc:1428] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.016s user 0.005s sys 0.002s
I20250109 21:10:54.393689 23206 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:54.395360 23203 raft_consensus.cc:357] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.396351 23203 raft_consensus.cc:383] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.396725 23203 raft_consensus.cc:738] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.397706 23203 consensus_queue.cc:260] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.399114 23218 leader_election.cc:290] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:54.399399 23233 raft_consensus.cc:491] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.400671 23233 raft_consensus.cc:513] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.401062 23203 ts_tablet_manager.cc:1428] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.009s user 0.007s sys 0.001s
I20250109 21:10:54.402449 23204 tablet_bootstrap.cc:492] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:54.402722 23203 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:54.404417 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:54.405133 23160 raft_consensus.cc:2463] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:54.406809 22901 leader_election.cc:304] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:10:54.407881 23229 raft_consensus.cc:2798] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:54.408241 23229 raft_consensus.cc:491] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:54.408566 23229 raft_consensus.cc:3054] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.409919 23204 tablet_bootstrap.cc:654] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.429061 23233 leader_election.cc:290] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:54.433429 23206 tablet_bootstrap.cc:654] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.436491 23203 tablet_bootstrap.cc:654] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.444535 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:54.446938 22899 leader_election.cc:343] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.450352 23202 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:54.450788 23202 ts_tablet_manager.cc:1397] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.068s user 0.014s sys 0.026s
I20250109 21:10:54.454064 23206 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:54.454723 23206 ts_tablet_manager.cc:1397] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.061s user 0.004s sys 0.010s
I20250109 21:10:54.454598 23202 raft_consensus.cc:357] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.455493 23202 raft_consensus.cc:383] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.455811 23202 raft_consensus.cc:738] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.456581 23202 consensus_queue.cc:260] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.461423 23229 raft_consensus.cc:513] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.464860 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:54.458675 23206 raft_consensus.cc:357] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.465487 23160 raft_consensus.cc:3054] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.465771 23206 raft_consensus.cc:383] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.466055 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1ba1f1f4b844cbeafa6098ff5b3a7ce" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.466727 22935 raft_consensus.cc:2463] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:54.467131 23203 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:54.467603 23203 ts_tablet_manager.cc:1397] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.065s user 0.010s sys 0.012s
I20250109 21:10:54.468225 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:54.468411 23051 leader_election.cc:304] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:54.469540 23218 raft_consensus.cc:2798] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250109 21:10:54.469715 22899 leader_election.cc:343] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.469892 23218 raft_consensus.cc:491] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:54.470305 23218 raft_consensus.cc:3054] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.470502 23229 leader_election.cc:290] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:54.470935 23203 raft_consensus.cc:357] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.471679 23203 raft_consensus.cc:383] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.471961 23203 raft_consensus.cc:738] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.472743 23203 consensus_queue.cc:260] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.474246 23160 raft_consensus.cc:2463] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:54.465029 23202 ts_tablet_manager.cc:1428] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.014s user 0.003s sys 0.005s
I20250109 21:10:54.474949 23203 ts_tablet_manager.cc:1428] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:54.475559 22901 leader_election.cc:304] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:54.476167 23202 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:54.476979 23229 raft_consensus.cc:2798] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.477712 23229 raft_consensus.cc:695] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:54.478740 23229 consensus_queue.cc:237] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.481379 23233 raft_consensus.cc:491] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.481892 23233 raft_consensus.cc:513] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.483189 23202 tablet_bootstrap.cc:654] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.483773 23204 tablet_bootstrap.cc:492] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:54.483973 23233 leader_election.cc:290] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:54.484321 23204 ts_tablet_manager.cc:1397] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.082s user 0.004s sys 0.020s
I20250109 21:10:54.485441 23218 raft_consensus.cc:513] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.487108 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:54.488392 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:54.489696 22900 leader_election.cc:343] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.490657 23203 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:54.493014 23204 raft_consensus.cc:357] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.494016 23220 raft_consensus.cc:491] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.495144 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1ba1f1f4b844cbeafa6098ff5b3a7ce" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:54.495904 23011 raft_consensus.cc:2463] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:54.495365 23220 raft_consensus.cc:513] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.497284 23203 tablet_bootstrap.cc:654] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.466099 23206 raft_consensus.cc:738] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.498564 23206 consensus_queue.cc:260] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.499603 23160 raft_consensus.cc:2463] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:54.503937 22901 leader_election.cc:304] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:54.505132 23233 raft_consensus.cc:2798] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:54.505498 23233 raft_consensus.cc:491] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:54.505846 23233 raft_consensus.cc:3054] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.506889 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1ba1f1f4b844cbeafa6098ff5b3a7ce" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:54.507601 23011 raft_consensus.cc:3054] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.509475 23220 leader_election.cc:290] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:54.511909 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f1ba1f1f4b844cbeafa6098ff5b3a7ce" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:54.512566 22935 raft_consensus.cc:3054] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.515549 23011 raft_consensus.cc:2463] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:54.515863 23218 leader_election.cc:290] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:54.517525 23206 ts_tablet_manager.cc:1428] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.062s user 0.004s sys 0.003s
I20250109 21:10:54.523371 23206 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:54.529855 23206 tablet_bootstrap.cc:654] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.535890 23202 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:54.536298 23206 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:54.536482 23202 ts_tablet_manager.cc:1397] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.061s user 0.022s sys 0.035s
I20250109 21:10:54.536831 23206 ts_tablet_manager.cc:1397] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.002s
I20250109 21:10:54.539124 23220 raft_consensus.cc:491] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.539682 23220 raft_consensus.cc:513] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.539914 23206 raft_consensus.cc:357] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.540226 23202 raft_consensus.cc:357] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.540727 23206 raft_consensus.cc:383] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.540814 22935 raft_consensus.cc:2463] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:54.541007 23202 raft_consensus.cc:383] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.541111 23206 raft_consensus.cc:738] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.541421 23202 raft_consensus.cc:738] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.542037 23051 leader_election.cc:304] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:54.542199 23202 consensus_queue.cc:260] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.542963 23218 raft_consensus.cc:2798] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.544970 23233 raft_consensus.cc:513] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.548342 23220 leader_election.cc:290] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:54.542135 23206 consensus_queue.cc:260] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.549515 23202 ts_tablet_manager.cc:1428] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.013s user 0.005s sys 0.004s
I20250109 21:10:54.550835 23202 tablet_bootstrap.cc:492] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:54.553279 23204 raft_consensus.cc:383] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.554291 23204 raft_consensus.cc:738] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.555909 23204 consensus_queue.cc:260] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.557657 23233 leader_election.cc:290] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:54.558434 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:54.562863 23160 raft_consensus.cc:3054] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.563953 23202 tablet_bootstrap.cc:654] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.575665 23160 raft_consensus.cc:2463] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:54.577323 22901 leader_election.cc:304] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:10:54.579821 23233 raft_consensus.cc:2798] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.580528 23233 raft_consensus.cc:695] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:54.582445 23267 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.581821 23233 consensus_queue.cc:237] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.582984 23267 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.585496 23267 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:54.585822 23218 raft_consensus.cc:695] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:54.587671 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:54.589223 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.589124 23218 consensus_queue.cc:237] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:10:54.590759 23051 leader_election.cc:343] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.603797 22831 catalog_manager.cc:5526] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
W20250109 21:10:54.615250 22900 leader_election.cc:343] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.622166 23204 ts_tablet_manager.cc:1428] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.137s user 0.001s sys 0.008s
I20250109 21:10:54.622885 23233 consensus_queue.cc:1035] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:54.624209 23204 tablet_bootstrap.cc:492] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:54.626545 23269 raft_consensus.cc:491] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.631964 23233 consensus_queue.cc:1035] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:54.633112 23218 raft_consensus.cc:491] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.644763 23218 raft_consensus.cc:513] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.651731 23218 leader_election.cc:290] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:54.653252 23206 ts_tablet_manager.cc:1428] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.116s user 0.015s sys 0.025s
I20250109 21:10:54.654024 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.656616 23202 tablet_bootstrap.cc:492] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:54.657449 23202 ts_tablet_manager.cc:1397] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.107s user 0.035s sys 0.051s
I20250109 21:10:54.660172 23202 raft_consensus.cc:357] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.660929 23202 raft_consensus.cc:383] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.661187 23202 raft_consensus.cc:738] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.661934 23202 consensus_queue.cc:260] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.656448 23215 raft_consensus.cc:491] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.663491 23215 raft_consensus.cc:513] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.665460 23215 leader_election.cc:290] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:54.646131 23269 raft_consensus.cc:513] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.666584 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39ae691cd7d54ac7b9e143a80bff4799" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:54.668267 23269 leader_election.cc:290] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:54.668525 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39ae691cd7d54ac7b9e143a80bff4799" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.669267 22934 raft_consensus.cc:2463] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:10:54.654604 23206 tablet_bootstrap.cc:492] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
W20250109 21:10:54.672537 23051 leader_election.cc:343] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:54.668560 22976 leader_election.cc:343] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.675753 22976 leader_election.cc:304] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:54.677585 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:54.678061 23215 raft_consensus.cc:2798] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:54.678129 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:54.678646 23215 raft_consensus.cc:491] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:54.679052 23215 raft_consensus.cc:3054] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.679744 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:54.679893 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:54.680514 23010 raft_consensus.cc:2463] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:54.674515 23202 ts_tablet_manager.cc:1428] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.017s user 0.006s sys 0.001s
I20250109 21:10:54.683867 23049 leader_election.cc:304] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:54.686328 23203 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:54.686862 23203 ts_tablet_manager.cc:1397] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.196s user 0.038s sys 0.048s
I20250109 21:10:54.664584 22831 catalog_manager.cc:5526] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
W20250109 21:10:54.689611 23051 leader_election.cc:343] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.689535 23203 raft_consensus.cc:357] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.690287 23203 raft_consensus.cc:383] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.690114 23051 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:54.690632 23203 raft_consensus.cc:738] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.691366 23269 raft_consensus.cc:2798] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:54.691768 23269 raft_consensus.cc:491] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:54.692113 23269 raft_consensus.cc:3054] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.696477 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:54.696878 23215 raft_consensus.cc:513] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.697283 23009 raft_consensus.cc:2463] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:54.698066 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:54.699230 23203 consensus_queue.cc:260] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:54.699646 23010 raft_consensus.cc:2463] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:54.701488 23203 ts_tablet_manager.cc:1428] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.014s user 0.004s sys 0.000s
I20250109 21:10:54.701887 23233 consensus_queue.cc:1035] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:54.703280 23202 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:54.698944 23218 raft_consensus.cc:2743] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:54.708637 23124 leader_election.cc:304] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:54.709596 23124 leader_election.cc:304] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:54.709959 23206 tablet_bootstrap.cc:654] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:54.711129 23051 leader_election.cc:343] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.711346 23220 raft_consensus.cc:2798] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:54.713825 23051 leader_election.cc:304] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:54.714278 23220 raft_consensus.cc:491] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:54.714622 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:54.714864 23218 raft_consensus.cc:2743] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:54.715358 23084 raft_consensus.cc:2463] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:54.715739 23268 raft_consensus.cc:2798] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
W20250109 21:10:54.716059 23051 leader_election.cc:343] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.716136 23268 raft_consensus.cc:491] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:54.714655 23220 raft_consensus.cc:3054] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.716761 23268 raft_consensus.cc:3054] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.722150 23204 tablet_bootstrap.cc:654] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.724733 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39ae691cd7d54ac7b9e143a80bff4799" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:54.727651 22934 raft_consensus.cc:3054] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.725217 23215 leader_election.cc:290] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:54.726274 23202 tablet_bootstrap.cc:654] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.726990 23203 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:54.734988 23269 raft_consensus.cc:513] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.740685 23220 raft_consensus.cc:513] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.744910 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:54.745596 23009 raft_consensus.cc:3054] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.748713 23268 raft_consensus.cc:513] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.750622 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:54.753683 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.754765 23220 leader_election.cc:290] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:10:54.756270 23051 leader_election.cc:343] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:54.756392 23126 leader_election.cc:343] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.756811 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
W20250109 21:10:54.758591 23126 leader_election.cc:343] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.744921 22934 raft_consensus.cc:2463] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:54.764045 22976 leader_election.cc:304] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:54.764851 23215 raft_consensus.cc:2798] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.765416 23215 raft_consensus.cc:695] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:10:54.766422 23215 consensus_queue.cc:237] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.738701 23269 leader_election.cc:290] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
W20250109 21:10:54.775171 23124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 65653.4us
I20250109 21:10:54.777040 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:54.777649 23008 raft_consensus.cc:3054] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.766582 22829 catalog_manager.cc:5526] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:54.770344 23010 raft_consensus.cc:3054] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.784031 23233 raft_consensus.cc:491] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.786283 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39ae691cd7d54ac7b9e143a80bff4799" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:54.787482 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:54.793347 23233 raft_consensus.cc:513] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.793882 23085 raft_consensus.cc:3054] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.795418 23233 leader_election.cc:290] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:54.797524 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:54.787972 23268 leader_election.cc:290] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:54.787911 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
W20250109 21:10:54.799022 22899 leader_election.cc:343] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.799230 23007 raft_consensus.cc:3054] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.790872 23008 raft_consensus.cc:2463] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:54.787504 23203 tablet_bootstrap.cc:654] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:54.810254 22976 leader_election.cc:343] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.818220 23009 raft_consensus.cc:2463] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:54.818835 23247 raft_consensus.cc:491] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.819561 23049 leader_election.cc:304] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:54.819343 23247 raft_consensus.cc:513] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.822045 23206 tablet_bootstrap.cc:492] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:54.822698 23206 ts_tablet_manager.cc:1397] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.168s user 0.026s sys 0.018s
I20250109 21:10:54.823681 23124 leader_election.cc:304] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:54.818692 23085 raft_consensus.cc:2463] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:54.825655 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.826743 23268 raft_consensus.cc:2798] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.827292 23268 raft_consensus.cc:695] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:54.828091 23268 consensus_queue.cc:237] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:54.830109 23125 leader_election.cc:304] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:54.831115 23218 raft_consensus.cc:2798] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.831221 23279 raft_consensus.cc:2798] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:54.831720 23218 raft_consensus.cc:695] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:54.832623 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:54.833307 23218 consensus_queue.cc:237] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.834619 23279 raft_consensus.cc:695] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:54.834710 23206 raft_consensus.cc:357] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.835636 23206 raft_consensus.cc:383] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.836200 23206 raft_consensus.cc:738] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.836962 23206 consensus_queue.cc:260] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.843161 23247 leader_election.cc:290] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:54.847983 23202 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:54.848465 23202 ts_tablet_manager.cc:1397] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.145s user 0.011s sys 0.002s
I20250109 21:10:54.849895 23007 raft_consensus.cc:2463] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:54.851016 23202 raft_consensus.cc:357] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.851744 23202 raft_consensus.cc:383] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.851997 23202 raft_consensus.cc:738] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.852702 23204 tablet_bootstrap.cc:492] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:54.853199 23204 ts_tablet_manager.cc:1397] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.229s user 0.014s sys 0.022s
I20250109 21:10:54.852718 23202 consensus_queue.cc:260] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.856146 23202 ts_tablet_manager.cc:1428] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.007s user 0.004s sys 0.003s
I20250109 21:10:54.857141 23202 tablet_bootstrap.cc:492] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:54.857779 23279 consensus_queue.cc:237] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.858646 22833 catalog_manager.cc:5526] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:54.860189 23206 ts_tablet_manager.cc:1428] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.037s user 0.006s sys 0.001s
I20250109 21:10:54.861299 23206 tablet_bootstrap.cc:492] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
W20250109 21:10:54.870266 22900 leader_election.cc:343] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.870833 23215 raft_consensus.cc:491] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.870780 22900 leader_election.cc:304] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:54.871493 23215 raft_consensus.cc:513] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.872512 23229 raft_consensus.cc:2743] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:54.872785 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:54.870682 23233 consensus_queue.cc:1035] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:54.873492 23215 leader_election.cc:290] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:54.875087 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:54.875447 22975 leader_election.cc:304] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:54.875809 22934 raft_consensus.cc:2463] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:10:54.875959 23202 tablet_bootstrap.cc:654] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.877034 22976 leader_election.cc:304] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:54.877900 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:54.879781 22975 leader_election.cc:343] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.875938 22829 catalog_manager.cc:5526] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } }
W20250109 21:10:54.882869 22899 consensus_peers.cc:487] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:54.881127 23247 raft_consensus.cc:2798] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:54.883720 23247 raft_consensus.cc:491] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:54.884070 23247 raft_consensus.cc:3054] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.891436 23204 raft_consensus.cc:357] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.893610 23204 raft_consensus.cc:383] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.894021 23204 raft_consensus.cc:738] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.896533 23204 consensus_queue.cc:260] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.897784 23202 tablet_bootstrap.cc:492] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:54.898267 23202 ts_tablet_manager.cc:1397] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.000s
I20250109 21:10:54.899448 23204 ts_tablet_manager.cc:1428] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.046s user 0.007s sys 0.001s
I20250109 21:10:54.900862 23202 raft_consensus.cc:357] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.901582 23202 raft_consensus.cc:383] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.901834 23202 raft_consensus.cc:738] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.910533 23202 consensus_queue.cc:260] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.913734 23206 tablet_bootstrap.cc:654] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.900830 23204 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:54.938048 22833 catalog_manager.cc:5526] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:54.966419 23203 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:54.966845 23203 ts_tablet_manager.cc:1397] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.240s user 0.040s sys 0.059s
I20250109 21:10:54.969524 23292 raft_consensus.cc:491] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.970105 23292 raft_consensus.cc:513] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.972090 23292 leader_election.cc:290] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:54.972829 23204 tablet_bootstrap.cc:654] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.961301 23247 raft_consensus.cc:513] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:54.973228 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
W20250109 21:10:54.974766 22976 leader_election.cc:343] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:54.976338 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:54.976910 22934 raft_consensus.cc:3054] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:54.981364 23203 raft_consensus.cc:357] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.984477 23203 raft_consensus.cc:383] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:54.984818 23203 raft_consensus.cc:738] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:54.987740 23203 consensus_queue.cc:260] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:54.983512 23247 leader_election.cc:290] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:54.990161 23203 ts_tablet_manager.cc:1428] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20250109 21:10:54.991490 23203 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:54.991833 22832 catalog_manager.cc:5526] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:54.997610 23203 tablet_bootstrap.cc:654] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:54.997998 23295 raft_consensus.cc:491] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:54.998503 23295 raft_consensus.cc:513] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.000633 23295 leader_election.cc:290] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.002167 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "414f03400b5e43529a493c039a7b7024" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:55.003391 22976 leader_election.cc:343] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.003949 23202 ts_tablet_manager.cc:1428] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.105s user 0.007s sys 0.003s
I20250109 21:10:55.004796 23202 tablet_bootstrap.cc:492] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:55.005087 23284 raft_consensus.cc:491] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.005609 23284 raft_consensus.cc:513] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.007728 23284 leader_election.cc:290] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.008042 22934 raft_consensus.cc:2463] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:55.009299 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:55.010704 22901 leader_election.cc:343] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.011685 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.012212 22976 leader_election.cc:304] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:55.012354 23084 raft_consensus.cc:2463] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:55.011960 23202 tablet_bootstrap.cc:654] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.013504 22900 leader_election.cc:304] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:55.014456 23207 raft_consensus.cc:2798] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.014793 23207 raft_consensus.cc:491] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.015127 23207 raft_consensus.cc:3054] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.016966 23233 consensus_queue.cc:1035] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:55.018966 23295 raft_consensus.cc:2798] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:55.022120 23295 raft_consensus.cc:695] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:10:55.025084 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.025502 23295 consensus_queue.cc:237] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.027896 23268 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.028353 23268 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:10:55.031097 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:55.031849 23215 raft_consensus.cc:2743] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:55.043080 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "414f03400b5e43529a493c039a7b7024" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.043911 23085 raft_consensus.cc:2463] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:10:55.047564 23233 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.048133 23233 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:10:55.048460 22975 leader_election.cc:343] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.056133 23206 tablet_bootstrap.cc:492] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:55.031737 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:55.056634 23206 ts_tablet_manager.cc:1397] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.196s user 0.012s sys 0.009s
I20250109 21:10:55.059551 23206 raft_consensus.cc:357] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.060258 23206 raft_consensus.cc:383] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.060523 23206 raft_consensus.cc:738] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.061287 23204 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:55.060946 23218 consensus_queue.cc:1035] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:55.050086 22975 leader_election.cc:304] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.061760 23204 ts_tablet_manager.cc:1397] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.161s user 0.011s sys 0.009s
I20250109 21:10:55.065384 23233 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.062659 22975 leader_election.cc:304] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:55.066154 23268 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:55.066617 23215 raft_consensus.cc:2743] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.066637 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.072420 22933 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:55.072808 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.073504 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:55.074229 23159 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:55.074347 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.075487 23126 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
W20250109 21:10:55.076053 22975 leader_election.cc:343] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:55.076444 23125 leader_election.cc:343] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.076992 22901 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
W20250109 21:10:55.077595 22900 leader_election.cc:343] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.077781 23284 raft_consensus.cc:2798] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.076468 23279 raft_consensus.cc:491] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.078425 23298 raft_consensus.cc:2798] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.078154 23284 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.080216 23298 raft_consensus.cc:491] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.081787 23298 raft_consensus.cc:3054] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.082394 23268 raft_consensus.cc:2798] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.082782 23268 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.083148 23268 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.079180 23206 consensus_queue.cc:260] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.078722 23279 raft_consensus.cc:513] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.080205 23204 raft_consensus.cc:357] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.085312 23204 raft_consensus.cc:383] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.085600 23204 raft_consensus.cc:738] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.086369 23204 consensus_queue.cc:260] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.084888 23284 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.093063 23279 leader_election.cc:290] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:55.094153 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:55.094617 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.095320 23010 raft_consensus.cc:2388] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 1: Already voted for candidate e1a492f3cf3a4827bb0045500a3abb83 in this term.
I20250109 21:10:55.100337 23207 raft_consensus.cc:513] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.103042 23125 leader_election.cc:304] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.103761 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:55.104533 23279 raft_consensus.cc:3054] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:55.105671 22901 leader_election.cc:343] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.104090 23207 leader_election.cc:290] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.107820 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:55.108444 23085 raft_consensus.cc:3054] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.113456 23204 ts_tablet_manager.cc:1428] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.051s user 0.007s sys 0.000s
I20250109 21:10:55.115706 23279 raft_consensus.cc:2743] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.117892 23206 ts_tablet_manager.cc:1428] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.061s user 0.006s sys 0.001s
I20250109 21:10:55.117883 23268 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.118954 23202 tablet_bootstrap.cc:492] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:55.119144 23206 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:55.119441 23202 ts_tablet_manager.cc:1397] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.115s user 0.017s sys 0.008s
I20250109 21:10:55.121155 23268 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:55.121076 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:55.122392 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:55.122458 23202 raft_consensus.cc:357] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.124413 23202 raft_consensus.cc:383] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.124718 23202 raft_consensus.cc:738] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
W20250109 21:10:55.125005 23125 leader_election.cc:343] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.125458 23202 consensus_queue.cc:260] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.127377 23204 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:55.128041 23202 ts_tablet_manager.cc:1428] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:55.128994 23202 tablet_bootstrap.cc:492] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:55.129469 23284 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.130671 22933 raft_consensus.cc:2388] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:55.132302 23218 consensus_queue.cc:1035] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:55.133520 23204 tablet_bootstrap.cc:654] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.134444 23202 tablet_bootstrap.cc:654] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.134452 23085 raft_consensus.cc:2463] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:55.139081 23203 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.139523 23203 ts_tablet_manager.cc:1397] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.148s user 0.013s sys 0.020s
I20250109 21:10:55.144119 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:55.145184 23206 tablet_bootstrap.cc:654] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.145280 23158 raft_consensus.cc:2388] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 51679b9f547940b6a8311fd6fab340f7 in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:10:55.145830 23126 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.146788 23268 raft_consensus.cc:2743] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.153548 23203 raft_consensus.cc:357] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.155174 23203 raft_consensus.cc:383] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.155642 23203 raft_consensus.cc:738] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.157801 23203 consensus_queue.cc:260] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.159008 22900 leader_election.cc:304] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:55.167974 23233 raft_consensus.cc:2798] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:55.168475 23233 raft_consensus.cc:695] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:55.169273 23233 consensus_queue.cc:237] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.174443 23207 consensus_queue.cc:1035] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:55.140035 23284 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.179662 23203 ts_tablet_manager.cc:1428] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.040s user 0.005s sys 0.001s
I20250109 21:10:55.180711 23203 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.186118 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:55.190781 23298 raft_consensus.cc:513] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
W20250109 21:10:55.192708 22900 leader_election.cc:343] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.193156 22900 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.193884 23284 raft_consensus.cc:2743] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.195091 23203 tablet_bootstrap.cc:654] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.197829 23298 leader_election.cc:290] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.200462 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "414f03400b5e43529a493c039a7b7024" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:55.201085 23085 raft_consensus.cc:3054] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.198895 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "414f03400b5e43529a493c039a7b7024" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:55.208340 23202 tablet_bootstrap.cc:492] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:55.209599 23202 ts_tablet_manager.cc:1397] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.081s user 0.024s sys 0.019s
I20250109 21:10:55.212905 22830 catalog_manager.cc:5526] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:55.213809 23202 raft_consensus.cc:357] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.214488 23202 raft_consensus.cc:383] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.214743 23202 raft_consensus.cc:738] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.216266 23202 consensus_queue.cc:260] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
W20250109 21:10:55.219924 22900 consensus_peers.cc:487] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 -> Peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Couldn't send request to peer e1a492f3cf3a4827bb0045500a3abb83. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:55.210522 23159 raft_consensus.cc:3054] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.232621 23202 ts_tablet_manager.cc:1428] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.023s user 0.005s sys 0.000s
I20250109 21:10:55.238601 23202 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:55.245267 23203 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.245735 23203 ts_tablet_manager.cc:1397] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.065s user 0.007s sys 0.021s
I20250109 21:10:55.248208 23203 raft_consensus.cc:357] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.248911 23203 raft_consensus.cc:383] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.249166 23203 raft_consensus.cc:738] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.249768 23203 consensus_queue.cc:260] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.253544 23204 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:55.254029 23204 ts_tablet_manager.cc:1397] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.127s user 0.016s sys 0.021s
I20250109 21:10:55.254400 23203 ts_tablet_manager.cc:1428] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20250109 21:10:55.256312 23204 raft_consensus.cc:357] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.257308 23204 raft_consensus.cc:383] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.257552 23204 raft_consensus.cc:738] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.258261 23159 raft_consensus.cc:2463] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:55.258147 23204 consensus_queue.cc:260] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.260630 23204 ts_tablet_manager.cc:1428] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:55.260782 22976 leader_election.cc:304] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:55.261531 23204 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:55.261550 23298 raft_consensus.cc:2798] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:55.262228 23298 raft_consensus.cc:695] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:10:55.263094 23298 consensus_queue.cc:237] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.263942 23202 tablet_bootstrap.cc:654] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.267546 22933 raft_consensus.cc:3054] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.269199 23204 tablet_bootstrap.cc:654] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.269903 23295 raft_consensus.cc:491] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.270414 23295 raft_consensus.cc:513] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.274366 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:55.275681 22975 leader_election.cc:343] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.278429 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:55.278295 23268 consensus_queue.cc:1035] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250109 21:10:55.279793 22976 leader_election.cc:343] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.280215 22976 leader_election.cc:304] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.280488 23295 leader_election.cc:290] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.281327 23295 raft_consensus.cc:2743] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.283828 23206 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:55.284425 23206 ts_tablet_manager.cc:1397] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.165s user 0.015s sys 0.021s
I20250109 21:10:55.270227 22829 catalog_manager.cc:5526] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:55.293242 23085 raft_consensus.cc:2463] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:55.295379 23203 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.287499 23206 raft_consensus.cc:357] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.307859 23206 raft_consensus.cc:383] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.308211 23206 raft_consensus.cc:738] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.308993 23206 consensus_queue.cc:260] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.314049 23204 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:55.314536 23204 ts_tablet_manager.cc:1397] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.053s user 0.015s sys 0.033s
I20250109 21:10:55.319516 23203 tablet_bootstrap.cc:654] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.324362 23268 consensus_queue.cc:1035] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:55.327764 23295 consensus_queue.cc:1035] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:55.333606 23206 ts_tablet_manager.cc:1428] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.049s user 0.007s sys 0.002s
I20250109 21:10:55.339135 23279 raft_consensus.cc:491] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.339643 23279 raft_consensus.cc:513] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.341746 23279 leader_election.cc:290] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:55.344882 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.345448 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.346261 23085 raft_consensus.cc:2388] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:55.348657 23125 leader_election.cc:304] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.349778 23279 raft_consensus.cc:3054] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.350512 22831 catalog_manager.cc:5526] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
W20250109 21:10:55.355700 22976 consensus_peers.cc:487] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Couldn't send request to peer 227e48f30ae84db6bff43cc2860219a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:55.352165 23206 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:55.358211 23279 raft_consensus.cc:2743] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.360796 23204 raft_consensus.cc:357] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.366736 23204 raft_consensus.cc:383] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.367100 23204 raft_consensus.cc:738] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.367803 23204 consensus_queue.cc:260] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.370325 23204 ts_tablet_manager.cc:1428] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.056s user 0.006s sys 0.002s
I20250109 21:10:55.353879 23202 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:55.365198 23203 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.366415 23206 tablet_bootstrap.cc:654] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.371023 23202 ts_tablet_manager.cc:1397] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.137s user 0.027s sys 0.020s
I20250109 21:10:55.371042 23203 ts_tablet_manager.cc:1397] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.098s user 0.039s sys 0.007s
I20250109 21:10:55.373771 23202 raft_consensus.cc:357] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.374595 23202 raft_consensus.cc:383] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.374898 23202 raft_consensus.cc:738] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.375993 23203 raft_consensus.cc:357] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.376288 23202 consensus_queue.cc:260] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.378014 23202 ts_tablet_manager.cc:1428] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:55.378770 23202 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:55.376699 23203 raft_consensus.cc:383] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.379339 23267 raft_consensus.cc:491] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.379856 23267 raft_consensus.cc:513] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.381625 23267 leader_election.cc:290] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.382402 23203 raft_consensus.cc:738] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.383039 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:55.383095 23203 consensus_queue.cc:260] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.385270 23203 ts_tablet_manager.cc:1428] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20250109 21:10:55.386258 23203 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.385972 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.388360 23204 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:55.389546 23218 consensus_queue.cc:1035] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:55.390484 23269 consensus_queue.cc:1035] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:55.394191 23204 tablet_bootstrap.cc:654] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.387126 22933 raft_consensus.cc:2388] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate df8c84b03e6f4a5288bdad949ba2447c in this term.
I20250109 21:10:55.412066 23051 leader_election.cc:304] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:55.412912 23267 raft_consensus.cc:3054] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.420487 23267 raft_consensus.cc:2743] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.420848 23279 consensus_queue.cc:1035] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:55.426539 23202 tablet_bootstrap.cc:654] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.441525 23203 tablet_bootstrap.cc:654] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.453665 23206 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:55.454123 23206 ts_tablet_manager.cc:1397] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.102s user 0.020s sys 0.047s
I20250109 21:10:55.460387 23206 raft_consensus.cc:357] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.462960 23298 consensus_queue.cc:1035] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:55.469198 23204 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:55.469740 23204 ts_tablet_manager.cc:1397] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.082s user 0.015s sys 0.010s
I20250109 21:10:55.471691 23203 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.472497 23203 ts_tablet_manager.cc:1397] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.086s user 0.017s sys 0.003s
I20250109 21:10:55.461117 23206 raft_consensus.cc:383] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.474990 23206 raft_consensus.cc:738] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.475786 23203 raft_consensus.cc:357] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.476811 23203 raft_consensus.cc:383] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.477275 23203 raft_consensus.cc:738] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.477737 23206 consensus_queue.cc:260] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.478106 23203 consensus_queue.cc:260] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.481302 23203 ts_tablet_manager.cc:1428] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.004s sys 0.002s
I20250109 21:10:55.482789 23203 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.476583 23204 raft_consensus.cc:357] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.488322 23204 raft_consensus.cc:383] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.488219 23268 consensus_queue.cc:1035] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:55.489821 23206 ts_tablet_manager.cc:1428] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.035s user 0.008s sys 0.000s
I20250109 21:10:55.489946 23203 tablet_bootstrap.cc:654] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.490819 23206 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:55.488675 23204 raft_consensus.cc:738] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.495677 23204 consensus_queue.cc:260] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.499465 23204 ts_tablet_manager.cc:1428] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.028s user 0.003s sys 0.002s
I20250109 21:10:55.500366 23204 tablet_bootstrap.cc:492] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:55.504040 23298 consensus_queue.cc:1035] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:55.512195 23267 raft_consensus.cc:491] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.512785 23267 raft_consensus.cc:513] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.514771 23267 leader_election.cc:290] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:55.516530 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:55.518246 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.528700 23206 tablet_bootstrap.cc:654] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.528985 23051 leader_election.cc:304] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:55.529397 23267 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.531556 23267 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.533968 23202 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:55.534379 23202 ts_tablet_manager.cc:1397] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.156s user 0.018s sys 0.030s
I20250109 21:10:55.536285 23203 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.531577 23218 raft_consensus.cc:2743] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.536777 23203 ts_tablet_manager.cc:1397] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.054s user 0.015s sys 0.011s
I20250109 21:10:55.535837 23295 raft_consensus.cc:491] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.538461 23295 raft_consensus.cc:513] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.540587 23295 leader_election.cc:290] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:55.540408 23203 raft_consensus.cc:357] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.541143 23203 raft_consensus.cc:383] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.541426 23203 raft_consensus.cc:738] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.542023 23203 consensus_queue.cc:260] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.542280 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
W20250109 21:10:55.543712 22976 leader_election.cc:343] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.544428 23203 ts_tablet_manager.cc:1428] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250109 21:10:55.548848 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.550148 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:55.551013 23158 raft_consensus.cc:2388] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:10:55.551885 23203 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.555110 23202 raft_consensus.cc:357] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.557842 23202 raft_consensus.cc:383] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250109 21:10:55.552498 22975 leader_election.cc:343] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.558593 22975 leader_election.cc:304] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.554113 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.561420 23233 raft_consensus.cc:491] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.561673 22935 raft_consensus.cc:2388] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:55.561936 23233 raft_consensus.cc:513] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.562860 23051 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:55.563702 23203 tablet_bootstrap.cc:654] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.563913 23233 leader_election.cc:290] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.563719 23218 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.552821 23267 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:55.566004 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:55.566533 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:55.567409 22901 leader_election.cc:343] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.558094 23202 raft_consensus.cc:738] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
W20250109 21:10:55.567896 22899 leader_election.cc:343] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.560853 23295 raft_consensus.cc:2743] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.569324 22899 leader_election.cc:304] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:55.570560 23233 raft_consensus.cc:2743] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.571971 23202 consensus_queue.cc:260] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.576833 23218 raft_consensus.cc:2743] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.581094 23204 tablet_bootstrap.cc:654] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.584626 23202 ts_tablet_manager.cc:1428] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.050s user 0.006s sys 0.002s
I20250109 21:10:55.585952 23202 tablet_bootstrap.cc:492] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:55.590458 23203 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.590941 23203 ts_tablet_manager.cc:1397] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.046s user 0.014s sys 0.017s
I20250109 21:10:55.610121 23295 raft_consensus.cc:491] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.610844 23295 raft_consensus.cc:513] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.614601 23204 tablet_bootstrap.cc:492] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:55.615154 23204 ts_tablet_manager.cc:1397] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.115s user 0.017s sys 0.015s
I20250109 21:10:55.615672 23202 tablet_bootstrap.cc:654] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.615413 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.616588 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:55.616899 22975 leader_election.cc:343] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:55.617769 22976 leader_election.cc:343] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.618263 22976 leader_election.cc:304] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.618268 23203 raft_consensus.cc:357] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.618701 23204 raft_consensus.cc:357] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.619235 23247 raft_consensus.cc:2743] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.619199 23203 raft_consensus.cc:383] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.619652 23204 raft_consensus.cc:383] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.619764 23203 raft_consensus.cc:738] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.617753 23295 leader_election.cc:290] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.620292 23206 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:55.620106 23204 raft_consensus.cc:738] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.620822 23206 ts_tablet_manager.cc:1397] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.130s user 0.016s sys 0.000s
I20250109 21:10:55.620608 23203 consensus_queue.cc:260] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.621186 23204 consensus_queue.cc:260] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.623073 23203 ts_tablet_manager.cc:1428] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.032s user 0.013s sys 0.010s
I20250109 21:10:55.623914 23204 ts_tablet_manager.cc:1428] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:55.624125 23203 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.625110 23204 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:55.630201 23203 tablet_bootstrap.cc:654] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.631309 23204 tablet_bootstrap.cc:654] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.637750 23233 consensus_queue.cc:1035] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:55.641880 23206 raft_consensus.cc:357] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.642737 23206 raft_consensus.cc:383] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.643100 23206 raft_consensus.cc:738] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.643875 23206 consensus_queue.cc:260] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.646303 23206 ts_tablet_manager.cc:1428] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.025s user 0.005s sys 0.001s
I20250109 21:10:55.647881 23218 raft_consensus.cc:491] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.648528 23218 raft_consensus.cc:513] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.650097 23206 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:55.652024 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.652700 22933 raft_consensus.cc:2463] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:55.653112 23218 leader_election.cc:290] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.653373 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:55.654067 23010 raft_consensus.cc:2463] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:55.654175 23051 leader_election.cc:304] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:55.655190 23218 raft_consensus.cc:2798] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.655619 23218 raft_consensus.cc:491] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.656013 23218 raft_consensus.cc:3054] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.659495 23202 tablet_bootstrap.cc:492] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:55.660192 23202 ts_tablet_manager.cc:1397] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.075s user 0.014s sys 0.001s
I20250109 21:10:55.663287 23202 raft_consensus.cc:357] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.663131 23218 raft_consensus.cc:513] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.664259 23202 raft_consensus.cc:383] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.664654 23202 raft_consensus.cc:738] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.665304 23202 consensus_queue.cc:260] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.667548 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:55.668176 22933 raft_consensus.cc:3054] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.668457 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:55.669066 23010 raft_consensus.cc:3054] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.676267 23010 raft_consensus.cc:2463] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:55.676121 23207 consensus_queue.cc:1035] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:55.676601 23085 raft_consensus.cc:3054] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.679256 23049 leader_election.cc:304] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:55.682690 23267 raft_consensus.cc:2798] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:55.683210 23267 raft_consensus.cc:695] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:55.683996 23267 consensus_queue.cc:237] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.685251 22933 raft_consensus.cc:2463] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:55.679277 23218 leader_election.cc:290] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.671013 23203 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.693001 23203 ts_tablet_manager.cc:1397] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.069s user 0.014s sys 0.003s
I20250109 21:10:55.695360 23203 raft_consensus.cc:357] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.695827 23203 raft_consensus.cc:383] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.696020 23203 raft_consensus.cc:738] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.696514 23203 consensus_queue.cc:260] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.698079 23206 tablet_bootstrap.cc:654] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.701207 23204 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:55.701614 23204 ts_tablet_manager.cc:1397] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.077s user 0.012s sys 0.019s
I20250109 21:10:55.704165 23204 raft_consensus.cc:357] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.704844 23204 raft_consensus.cc:383] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.705099 23204 raft_consensus.cc:738] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.705689 23204 consensus_queue.cc:260] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.707957 23204 ts_tablet_manager.cc:1428] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20250109 21:10:55.708716 23206 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:55.708889 23204 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:55.709177 23206 ts_tablet_manager.cc:1397] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.059s user 0.010s sys 0.000s
I20250109 21:10:55.711594 23206 raft_consensus.cc:357] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.712494 23206 raft_consensus.cc:383] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.712757 23206 raft_consensus.cc:738] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.713407 23206 consensus_queue.cc:260] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.714994 23204 tablet_bootstrap.cc:654] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.698581 23203 ts_tablet_manager.cc:1428] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.005s user 0.002s sys 0.000s
I20250109 21:10:55.698836 23202 ts_tablet_manager.cc:1428] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20250109 21:10:55.717096 23295 consensus_queue.cc:1035] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:55.717581 23203 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.724260 23203 tablet_bootstrap.cc:654] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.726953 23218 raft_consensus.cc:491] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.727434 23218 raft_consensus.cc:513] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.729794 23218 leader_election.cc:290] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.731719 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.732612 22933 raft_consensus.cc:2463] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:55.733078 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:55.716471 23206 ts_tablet_manager.cc:1428] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250109 21:10:55.735716 23051 leader_election.cc:304] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:55.736752 23010 raft_consensus.cc:2463] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:55.736742 23267 raft_consensus.cc:2798] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.739873 23267 raft_consensus.cc:491] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.740198 23267 raft_consensus.cc:3054] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.741189 23202 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:55.738504 22830 catalog_manager.cc:5526] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:55.754127 23207 raft_consensus.cc:491] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.754796 23207 raft_consensus.cc:513] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.758262 23206 tablet_bootstrap.cc:492] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:55.759662 23207 leader_election.cc:290] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.758618 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:55.760533 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:55.761068 23159 raft_consensus.cc:2463] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
W20250109 21:10:55.762308 22899 leader_election.cc:343] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.763123 22901 leader_election.cc:304] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:55.764565 23207 raft_consensus.cc:2798] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.765029 23207 raft_consensus.cc:491] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.765456 23207 raft_consensus.cc:3054] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.772413 23203 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.772989 23203 ts_tablet_manager.cc:1397] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.056s user 0.019s sys 0.017s
I20250109 21:10:55.774441 23204 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:55.774892 23204 ts_tablet_manager.cc:1397] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.066s user 0.019s sys 0.038s
I20250109 21:10:55.775872 23202 tablet_bootstrap.cc:654] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.775909 23203 raft_consensus.cc:357] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.777091 23203 raft_consensus.cc:383] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.777410 23203 raft_consensus.cc:738] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.777371 23204 raft_consensus.cc:357] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.778231 23204 raft_consensus.cc:383] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.778528 23204 raft_consensus.cc:738] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.778373 23203 consensus_queue.cc:260] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.779582 23159 raft_consensus.cc:3054] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.779384 23204 consensus_queue.cc:260] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.781489 23218 raft_consensus.cc:491] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.781559 23203 ts_tablet_manager.cc:1428] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:55.781989 23218 raft_consensus.cc:513] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.783087 23203 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.784018 23218 leader_election.cc:290] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.785552 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdcdd56a86d4793892b6a99883be239" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:55.787321 23049 leader_election.cc:343] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.787452 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdcdd56a86d4793892b6a99883be239" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.788081 22933 raft_consensus.cc:2463] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:55.788477 23207 raft_consensus.cc:513] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.788497 23204 ts_tablet_manager.cc:1428] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.013s user 0.004s sys 0.002s
I20250109 21:10:55.789353 23051 leader_election.cc:304] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:55.790266 23204 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:55.790561 23218 raft_consensus.cc:2798] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.790963 23218 raft_consensus.cc:491] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.791299 23218 raft_consensus.cc:3054] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.791225 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:55.791952 23160 raft_consensus.cc:3054] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.796332 23204 tablet_bootstrap.cc:654] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.804011 23298 consensus_queue.cc:1035] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:55.768887 23267 raft_consensus.cc:513] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.808913 23233 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.809593 23233 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.812109 23233 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.814225 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.814908 23084 raft_consensus.cc:2463] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:55.816044 22900 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:55.816797 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:55.818522 22901 leader_election.cc:343] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.819682 23233 raft_consensus.cc:2798] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.820279 23233 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.820735 23233 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.825834 23267 leader_election.cc:290] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.826609 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:55.826854 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:55.827275 22933 raft_consensus.cc:3054] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.827502 23010 raft_consensus.cc:3054] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.819583 23218 raft_consensus.cc:513] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.833696 23218 leader_election.cc:290] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.834693 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdcdd56a86d4793892b6a99883be239" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:55.835903 22935 raft_consensus.cc:3054] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.836678 23010 raft_consensus.cc:2463] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:55.834844 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdcdd56a86d4793892b6a99883be239" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:55.838222 23049 leader_election.cc:304] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:55.839282 23267 raft_consensus.cc:2798] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
W20250109 21:10:55.839577 23049 leader_election.cc:343] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.839917 23267 raft_consensus.cc:695] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:55.840767 23267 consensus_queue.cc:237] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.841905 23160 raft_consensus.cc:2463] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:55.843569 22901 leader_election.cc:304] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:10:55.844412 23284 raft_consensus.cc:2798] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:55.844868 23284 raft_consensus.cc:695] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:55.845139 23206 tablet_bootstrap.cc:654] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.845662 23284 consensus_queue.cc:237] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.848016 23203 tablet_bootstrap.cc:654] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.849727 22935 raft_consensus.cc:2463] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:55.853744 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:55.854523 23202 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:55.855024 23202 ts_tablet_manager.cc:1397] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.114s user 0.012s sys 0.000s
W20250109 21:10:55.855499 22899 leader_election.cc:343] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.856407 23207 leader_election.cc:290] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.857931 23051 leader_election.cc:304] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:55.859504 23218 raft_consensus.cc:2798] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:55.860898 23202 raft_consensus.cc:357] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.861590 23202 raft_consensus.cc:383] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.861846 23202 raft_consensus.cc:738] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.861892 23218 raft_consensus.cc:695] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:55.852550 23233 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.863379 23218 consensus_queue.cc:237] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.862494 23202 consensus_queue.cc:260] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.865672 22933 raft_consensus.cc:2463] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:55.878538 23207 raft_consensus.cc:491] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.879549 23233 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.879848 23207 raft_consensus.cc:513] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.880060 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:55.888154 23207 leader_election.cc:290] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.889979 23202 ts_tablet_manager.cc:1428] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.035s user 0.006s sys 0.000s
I20250109 21:10:55.892654 23202 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:55.893474 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0202de32424df98541f334960f7fe2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:55.892679 23204 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:55.894503 23204 ts_tablet_manager.cc:1397] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.104s user 0.024s sys 0.024s
W20250109 21:10:55.894892 22901 leader_election.cc:343] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.893340 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0202de32424df98541f334960f7fe2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:55.897183 22899 leader_election.cc:343] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.897652 22899 leader_election.cc:304] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:55.897959 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
W20250109 21:10:55.898607 22901 leader_election.cc:343] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.898627 23085 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.899544 23207 raft_consensus.cc:2743] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:55.899619 23204 raft_consensus.cc:357] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.900820 23204 raft_consensus.cc:383] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.901131 23204 raft_consensus.cc:738] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.901050 22830 catalog_manager.cc:5526] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:55.901856 23204 consensus_queue.cc:260] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.904249 23204 ts_tablet_manager.cc:1428] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.009s user 0.005s sys 0.001s
I20250109 21:10:55.905442 23204 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:55.905483 23202 tablet_bootstrap.cc:654] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.911214 23268 raft_consensus.cc:491] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.911574 23204 tablet_bootstrap.cc:654] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.911818 23268 raft_consensus.cc:513] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.912040 22833 catalog_manager.cc:5526] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:55.913852 23268 leader_election.cc:290] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.913722 22833 catalog_manager.cc:5526] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:55.915660 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:55.917645 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
W20250109 21:10:55.918010 23124 leader_election.cc:343] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.918332 22933 raft_consensus.cc:2463] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:55.919629 23126 leader_election.cc:304] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:55.920531 23203 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.920683 23268 raft_consensus.cc:2798] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.920985 23203 ts_tablet_manager.cc:1397] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.138s user 0.022s sys 0.018s
I20250109 21:10:55.921025 23268 raft_consensus.cc:491] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.921491 23268 raft_consensus.cc:3054] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.923780 23203 raft_consensus.cc:357] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.924521 23203 raft_consensus.cc:383] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.924645 23206 tablet_bootstrap.cc:492] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:55.924841 23203 raft_consensus.cc:738] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.925678 23203 consensus_queue.cc:260] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.927997 23203 ts_tablet_manager.cc:1428] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20250109 21:10:55.928498 23085 raft_consensus.cc:2463] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:55.928365 23268 raft_consensus.cc:513] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:55.929488 23218 raft_consensus.cc:491] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.929992 22900 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:55.929992 23218 raft_consensus.cc:513] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.931293 23284 raft_consensus.cc:2798] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:55.931782 23284 raft_consensus.cc:695] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:55.932240 23218 leader_election.cc:290] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:55.932940 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:55.932600 23284 consensus_queue.cc:237] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.936116 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:55.937937 23051 leader_election.cc:343] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.933601 23010 raft_consensus.cc:2463] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:55.939829 23203 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.940089 23049 leader_election.cc:304] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:55.944883 23218 raft_consensus.cc:2798] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:55.945340 23218 raft_consensus.cc:491] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:55.945775 23218 raft_consensus.cc:3054] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.947490 23298 raft_consensus.cc:491] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.948135 23298 raft_consensus.cc:513] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:55.949525 23203 tablet_bootstrap.cc:654] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.951038 23298 leader_election.cc:290] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:55.955201 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdcdd56a86d4793892b6a99883be239" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:55.961015 23203 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:55.961503 23203 ts_tablet_manager.cc:1397] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.022s user 0.004s sys 0.006s
I20250109 21:10:55.962276 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdcdd56a86d4793892b6a99883be239" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.963111 22933 raft_consensus.cc:2388] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate e1a492f3cf3a4827bb0045500a3abb83 in this term.
I20250109 21:10:55.964412 22976 leader_election.cc:304] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:55.966492 23298 raft_consensus.cc:3054] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.968272 23203 raft_consensus.cc:357] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.968997 23203 raft_consensus.cc:383] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.969269 23203 raft_consensus.cc:738] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.971967 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:55.972820 22933 raft_consensus.cc:3054] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:55.973734 23203 consensus_queue.cc:260] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.978372 23203 ts_tablet_manager.cc:1428] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.017s user 0.006s sys 0.002s
I20250109 21:10:55.979394 23203 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:55.925292 23206 ts_tablet_manager.cc:1397] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.167s user 0.021s sys 0.004s
I20250109 21:10:55.983479 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
W20250109 21:10:55.985088 23124 leader_election.cc:343] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:55.987149 23268 leader_election.cc:290] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:55.988907 22933 raft_consensus.cc:2463] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:55.990435 23126 leader_election.cc:304] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:55.992062 23203 tablet_bootstrap.cc:654] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:55.992233 23267 raft_consensus.cc:491] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:55.986196 23206 raft_consensus.cc:357] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:55.992883 23267 raft_consensus.cc:513] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:55.995262 23267 leader_election.cc:290] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:55.997217 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:55.997870 22935 raft_consensus.cc:2463] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:55.998710 23206 raft_consensus.cc:383] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:55.999029 23206 raft_consensus.cc:738] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:55.999154 23051 leader_election.cc:304] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:55.999372 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:55.999960 23267 raft_consensus.cc:2798] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:56.000458 23267 raft_consensus.cc:491] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:56.000818 23267 raft_consensus.cc:3054] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:56.000867 23051 leader_election.cc:343] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.002712 23206 consensus_queue.cc:260] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.004070 22833 catalog_manager.cc:5526] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:55.990818 23298 raft_consensus.cc:2743] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:56.007323 23284 raft_consensus.cc:491] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.007690 23279 raft_consensus.cc:2798] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:56.007814 23284 raft_consensus.cc:513] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.008205 23279 raft_consensus.cc:695] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:56.009070 23279 consensus_queue.cc:237] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.010840 23206 ts_tablet_manager.cc:1428] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.028s user 0.006s sys 0.000s
I20250109 21:10:56.011873 23206 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:56.014539 23284 leader_election.cc:290] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:56.014772 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4b07d8e80744b782d3fb265f1d0ca7" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:56.018108 23204 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:56.017971 23218 raft_consensus.cc:513] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.018723 23204 ts_tablet_manager.cc:1397] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.113s user 0.046s sys 0.042s
I20250109 21:10:56.020239 23218 leader_election.cc:290] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
W20250109 21:10:56.021517 22900 leader_election.cc:343] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.021799 23204 raft_consensus.cc:357] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.022678 23204 raft_consensus.cc:383] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.023043 23204 raft_consensus.cc:738] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.022857 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:56.024073 23159 raft_consensus.cc:3054] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:56.027127 23203 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:56.027611 23203 ts_tablet_manager.cc:1397] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.048s user 0.007s sys 0.003s
I20250109 21:10:56.028635 23206 tablet_bootstrap.cc:654] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.028435 22829 catalog_manager.cc:5526] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:56.030041 23203 raft_consensus.cc:357] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.030701 23203 raft_consensus.cc:383] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.030972 23203 raft_consensus.cc:738] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.031350 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:56.032143 23010 raft_consensus.cc:3054] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:56.037820 23203 consensus_queue.cc:260] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.041527 23203 ts_tablet_manager.cc:1428] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20250109 21:10:56.043232 23159 raft_consensus.cc:2463] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:56.044126 23203 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:56.014737 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4b07d8e80744b782d3fb265f1d0ca7" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:56.023734 23204 consensus_queue.cc:260] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:10:56.046250 22901 leader_election.cc:343] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.046711 22901 leader_election.cc:304] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:56.047814 23284 raft_consensus.cc:2743] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:56.049937 23204 ts_tablet_manager.cc:1428] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.031s user 0.004s sys 0.002s
I20250109 21:10:56.051529 23051 leader_election.cc:304] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:56.052356 23218 raft_consensus.cc:2798] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:56.052822 23218 raft_consensus.cc:695] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:56.053683 23202 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:56.053627 23218 consensus_queue.cc:237] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.054229 23202 ts_tablet_manager.cc:1397] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.162s user 0.031s sys 0.021s
I20250109 21:10:56.055492 23267 raft_consensus.cc:513] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.057324 23204 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:56.057014 23202 raft_consensus.cc:357] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.064672 23202 raft_consensus.cc:383] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.064961 23202 raft_consensus.cc:738] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.065599 23202 consensus_queue.cc:260] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.067754 23202 ts_tablet_manager.cc:1428] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.013s user 0.006s sys 0.000s
I20250109 21:10:56.068543 23204 tablet_bootstrap.cc:654] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.070256 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
W20250109 21:10:56.073820 23051 leader_election.cc:343] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.074999 23267 leader_election.cc:290] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:56.075718 23207 raft_consensus.cc:491] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.077172 23207 raft_consensus.cc:513] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.077657 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:56.078282 22933 raft_consensus.cc:3054] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:56.079355 23207 leader_election.cc:290] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:56.080394 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:56.080658 23284 raft_consensus.cc:491] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.081105 23284 raft_consensus.cc:513] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.082082 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:56.085783 22900 leader_election.cc:343] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.085934 23202 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
W20250109 21:10:56.091588 22901 leader_election.cc:343] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.094023 22901 leader_election.cc:304] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:56.099324 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27c19622df5416eb965291aeb863154" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:56.100558 23207 raft_consensus.cc:2743] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:56.100852 22899 leader_election.cc:343] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.092244 23284 leader_election.cc:290] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:56.101954 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27c19622df5416eb965291aeb863154" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:56.106652 23202 tablet_bootstrap.cc:654] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.108888 23206 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:56.109359 23206 ts_tablet_manager.cc:1397] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.098s user 0.010s sys 0.026s
I20250109 21:10:56.111975 23206 raft_consensus.cc:357] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:10:56.111986 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:56.112684 23206 raft_consensus.cc:383] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.113008 23206 raft_consensus.cc:738] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.093667 23010 raft_consensus.cc:2463] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
W20250109 21:10:56.120323 22901 leader_election.cc:343] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.113698 23206 consensus_queue.cc:260] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.115088 23298 raft_consensus.cc:491] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.121351 23298 raft_consensus.cc:513] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.123359 23298 leader_election.cc:290] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:56.124817 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eaeb5702b8c4c15a530b7f4bc0b1990" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:56.126180 22976 leader_election.cc:343] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.127899 22831 catalog_manager.cc:5526] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:56.128844 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eaeb5702b8c4c15a530b7f4bc0b1990" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:56.130900 23206 ts_tablet_manager.cc:1428] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.021s user 0.006s sys 0.001s
W20250109 21:10:56.130823 22975 leader_election.cc:343] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.131543 22975 leader_election.cc:304] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:56.132053 23206 tablet_bootstrap.cc:492] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:56.132555 23215 raft_consensus.cc:491] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.133116 23215 raft_consensus.cc:513] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.137920 23206 tablet_bootstrap.cc:654] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.116695 23203 tablet_bootstrap.cc:654] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.120815 22901 leader_election.cc:304] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:56.139874 23233 raft_consensus.cc:2743] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:56.141678 23215 leader_election.cc:290] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:56.142370 23215 raft_consensus.cc:2743] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:56.145387 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:56.147346 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:56.148121 22935 raft_consensus.cc:2388] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:10:56.149353 22976 leader_election.cc:304] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:56.150945 23298 raft_consensus.cc:3054] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:56.156250 23203 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:56.156816 23203 ts_tablet_manager.cc:1397] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.113s user 0.008s sys 0.007s
I20250109 21:10:56.160732 23206 tablet_bootstrap.cc:492] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:56.161180 23206 ts_tablet_manager.cc:1397] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.029s user 0.006s sys 0.004s
I20250109 21:10:56.164244 23202 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:56.163995 23206 raft_consensus.cc:357] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.164722 23202 ts_tablet_manager.cc:1397] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.079s user 0.019s sys 0.030s
I20250109 21:10:56.164829 23206 raft_consensus.cc:383] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.165228 23206 raft_consensus.cc:738] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.166142 23298 raft_consensus.cc:2743] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:56.165915 23206 consensus_queue.cc:260] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.159229 23203 raft_consensus.cc:357] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.168237 23203 raft_consensus.cc:383] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.167852 23202 raft_consensus.cc:357] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.168556 23203 raft_consensus.cc:738] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.168694 23202 raft_consensus.cc:383] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.169031 23202 raft_consensus.cc:738] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.169662 23202 consensus_queue.cc:260] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.170329 22933 raft_consensus.cc:2463] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:56.170708 23204 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:56.171234 23204 ts_tablet_manager.cc:1397] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.114s user 0.013s sys 0.004s
I20250109 21:10:56.171645 23051 leader_election.cc:304] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:56.172820 23218 raft_consensus.cc:2798] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:56.173301 23218 raft_consensus.cc:695] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:56.173564 23206 ts_tablet_manager.cc:1428] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.012s user 0.006s sys 0.001s
I20250109 21:10:56.174594 23206 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:56.174050 23218 consensus_queue.cc:237] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.175201 23203 consensus_queue.cc:260] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.177556 23203 ts_tablet_manager.cc:1428] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.020s user 0.005s sys 0.001s
I20250109 21:10:56.178485 23203 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:56.171903 23202 ts_tablet_manager.cc:1428] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250109 21:10:56.186483 23206 tablet_bootstrap.cc:654] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.191789 23203 tablet_bootstrap.cc:654] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.196029 23202 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:56.198828 23206 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:56.199306 23206 ts_tablet_manager.cc:1397] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.025s user 0.010s sys 0.000s
I20250109 21:10:56.203127 23202 tablet_bootstrap.cc:654] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.203397 23203 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:56.203852 23203 ts_tablet_manager.cc:1397] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.000s
I20250109 21:10:56.206327 23203 raft_consensus.cc:357] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.206933 23202 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:56.207114 23203 raft_consensus.cc:383] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.206384 22833 catalog_manager.cc:5526] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:56.201774 23206 raft_consensus.cc:357] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.207405 23202 ts_tablet_manager.cc:1397] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20250109 21:10:56.208022 23206 raft_consensus.cc:383] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.208350 23206 raft_consensus.cc:738] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.208199 23204 raft_consensus.cc:357] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.209075 23204 raft_consensus.cc:383] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.209591 23204 raft_consensus.cc:738] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.209076 23206 consensus_queue.cc:260] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.210364 23204 consensus_queue.cc:260] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.210495 23202 raft_consensus.cc:357] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.211517 23202 raft_consensus.cc:383] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.211836 23202 raft_consensus.cc:738] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.212441 23202 consensus_queue.cc:260] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.212962 23204 ts_tablet_manager.cc:1428] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.041s user 0.005s sys 0.001s
I20250109 21:10:56.213976 23204 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:56.214679 23206 ts_tablet_manager.cc:1428] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20250109 21:10:56.215641 23206 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:56.207474 23203 raft_consensus.cc:738] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.219620 23204 tablet_bootstrap.cc:654] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.219329 23203 consensus_queue.cc:260] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.221659 23203 ts_tablet_manager.cc:1428] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20250109 21:10:56.222592 23203 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:56.225847 23202 ts_tablet_manager.cc:1428] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.018s user 0.005s sys 0.000s
I20250109 21:10:56.227152 23202 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:56.227596 23233 raft_consensus.cc:491] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.228051 23233 raft_consensus.cc:513] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.230007 23233 leader_election.cc:290] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:56.231642 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:56.232317 23010 raft_consensus.cc:2463] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:56.233973 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:56.234606 23084 raft_consensus.cc:2463] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:56.235200 23202 tablet_bootstrap.cc:654] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.235869 22899 leader_election.cc:304] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:56.237607 23233 raft_consensus.cc:2798] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:56.238116 23233 raft_consensus.cc:491] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:56.238539 23233 raft_consensus.cc:3054] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:56.255121 23220 raft_consensus.cc:491] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.255970 23206 tablet_bootstrap.cc:654] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.255658 23220 raft_consensus.cc:513] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.257107 23203 tablet_bootstrap.cc:654] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.257870 23220 leader_election.cc:290] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:56.259486 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eaeb5702b8c4c15a530b7f4bc0b1990" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:56.261703 23125 leader_election.cc:343] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:56.264997 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eaeb5702b8c4c15a530b7f4bc0b1990" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:56.265740 23010 raft_consensus.cc:2463] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:56.269327 23267 consensus_queue.cc:1035] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:56.272030 23124 leader_election.cc:304] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:56.255051 23233 raft_consensus.cc:513] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.279390 23218 consensus_queue.cc:1035] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:56.283885 23268 raft_consensus.cc:2798] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:56.284372 23268 raft_consensus.cc:491] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:56.284768 23268 raft_consensus.cc:3054] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:56.288417 23267 consensus_queue.cc:1035] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:56.305627 23269 consensus_queue.cc:1035] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:56.357436 23267 raft_consensus.cc:491] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.358080 23267 raft_consensus.cc:513] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.359328 23202 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:56.359859 23202 ts_tablet_manager.cc:1397] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.133s user 0.004s sys 0.018s
I20250109 21:10:56.362388 23202 raft_consensus.cc:357] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.390350 23202 raft_consensus.cc:383] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.393523 23202 raft_consensus.cc:738] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.394397 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4b07d8e80744b782d3fb265f1d0ca7" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:56.395150 23159 raft_consensus.cc:2463] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:56.394333 23202 consensus_queue.cc:260] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.404181 23051 leader_election.cc:304] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:56.405051 23202 ts_tablet_manager.cc:1428] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.045s user 0.006s sys 0.000s
I20250109 21:10:56.406095 23202 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:56.410048 23267 leader_election.cc:290] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:56.412767 23267 consensus_queue.cc:1035] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:56.414352 23215 raft_consensus.cc:491] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.418061 23215 raft_consensus.cc:513] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.420859 23215 leader_election.cc:290] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:56.422986 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:56.428728 23267 raft_consensus.cc:2798] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:56.430678 23267 raft_consensus.cc:491] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:56.432338 23267 raft_consensus.cc:3054] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:56.433782 23268 raft_consensus.cc:513] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.438030 23220 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.438652 23220 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.441372 23220 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:56.443831 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:56.444890 23084 raft_consensus.cc:2388] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:56.463924 23202 tablet_bootstrap.cc:654] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.679849 23298 raft_consensus.cc:491] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.680622 23298 raft_consensus.cc:513] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.683158 23268 leader_election.cc:290] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:56.687405 23267 raft_consensus.cc:513] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.744352 23298 leader_election.cc:290] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
W20250109 21:10:56.803297 23204 thread.cc:635] log-alloc [worker] (thread pool) Time spent creating pthread: real 0.581s user 0.045s sys 0.099s
W20250109 21:10:56.812155 23204 thread.cc:601] log-alloc [worker] (thread pool) Time spent starting thread: real 0.584s user 0.045s sys 0.099s
I20250109 21:10:56.820910 23202 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:56.821662 23202 ts_tablet_manager.cc:1397] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.416s user 0.032s sys 0.056s
I20250109 21:10:56.824426 23202 raft_consensus.cc:357] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.825443 23202 raft_consensus.cc:383] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.825711 23202 raft_consensus.cc:738] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.826467 23202 consensus_queue.cc:260] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.835912 23202 ts_tablet_manager.cc:1428] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.014s user 0.009s sys 0.000s
I20250109 21:10:56.837510 23206 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:56.838201 23206 ts_tablet_manager.cc:1397] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.623s user 0.030s sys 0.059s
I20250109 21:10:56.839895 23202 tablet_bootstrap.cc:492] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:56.859042 23267 leader_election.cc:290] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:56.863749 23204 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:56.864163 23204 ts_tablet_manager.cc:1397] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.650s user 0.050s sys 0.105s
I20250109 21:10:56.877933 23204 raft_consensus.cc:357] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.878729 23204 raft_consensus.cc:383] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.879027 23204 raft_consensus.cc:738] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.879629 23204 consensus_queue.cc:260] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.880920 23202 tablet_bootstrap.cc:654] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.881961 23204 ts_tablet_manager.cc:1428] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20250109 21:10:56.884527 23203 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:56.884104 23206 raft_consensus.cc:357] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.884886 23206 raft_consensus.cc:383] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.885004 23203 ts_tablet_manager.cc:1397] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.663s user 0.013s sys 0.000s
I20250109 21:10:56.885183 23206 raft_consensus.cc:738] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.885855 23206 consensus_queue.cc:260] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.887542 23206 ts_tablet_manager.cc:1428] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.049s user 0.004s sys 0.002s
I20250109 21:10:56.888451 23204 tablet_bootstrap.cc:492] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:56.890280 23206 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:56.890841 23202 tablet_bootstrap.cc:492] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:56.891327 23202 ts_tablet_manager.cc:1397] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.054s user 0.009s sys 0.003s
I20250109 21:10:56.893275 23202 raft_consensus.cc:357] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.893731 23202 raft_consensus.cc:383] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.893929 23202 raft_consensus.cc:738] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.896715 23206 tablet_bootstrap.cc:654] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.901870 23206 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:56.902324 23206 ts_tablet_manager.cc:1397] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.012s user 0.011s sys 0.000s
I20250109 21:10:56.905431 23204 tablet_bootstrap.cc:654] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.905030 23206 raft_consensus.cc:357] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.905800 23206 raft_consensus.cc:383] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.906092 23206 raft_consensus.cc:738] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.906764 23206 consensus_queue.cc:260] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.908993 23206 ts_tablet_manager.cc:1428] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:10:56.909929 23206 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:56.914520 23203 raft_consensus.cc:357] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.915268 23203 raft_consensus.cc:383] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.915552 23203 raft_consensus.cc:738] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.916201 23203 consensus_queue.cc:260] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.918030 23203 ts_tablet_manager.cc:1428] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.033s user 0.006s sys 0.002s
I20250109 21:10:56.918944 23203 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:56.920565 23204 tablet_bootstrap.cc:492] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:56.920938 23204 ts_tablet_manager.cc:1397] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.038s user 0.014s sys 0.002s
I20250109 21:10:56.922730 23204 raft_consensus.cc:357] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.923260 23204 raft_consensus.cc:383] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.923468 23204 raft_consensus.cc:738] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.923877 23204 consensus_queue.cc:260] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:56.924779 23203 tablet_bootstrap.cc:654] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.925617 23204 ts_tablet_manager.cc:1428] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.004s user 0.003s sys 0.000s
I20250109 21:10:56.926386 23204 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:56.930611 23204 tablet_bootstrap.cc:654] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.930794 23206 tablet_bootstrap.cc:654] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.932525 23203 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:56.933049 23203 ts_tablet_manager.cc:1397] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.014s user 0.010s sys 0.000s
I20250109 21:10:56.936400 23203 raft_consensus.cc:357] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.937562 23203 raft_consensus.cc:383] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.938151 23203 raft_consensus.cc:738] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.938988 23203 consensus_queue.cc:260] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.941890 23203 ts_tablet_manager.cc:1428] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:56.943073 23203 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:56.950533 23203 tablet_bootstrap.cc:654] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.953136 23206 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:56.953629 23206 ts_tablet_manager.cc:1397] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.044s user 0.009s sys 0.016s
I20250109 21:10:56.956151 23206 raft_consensus.cc:357] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.956871 23206 raft_consensus.cc:383] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.957131 23206 raft_consensus.cc:738] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.957170 23204 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:56.957382 23203 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:56.958115 23203 ts_tablet_manager.cc:1397] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.015s user 0.011s sys 0.003s
I20250109 21:10:56.958140 23204 ts_tablet_manager.cc:1397] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.032s user 0.021s sys 0.004s
I20250109 21:10:56.957943 23206 consensus_queue.cc:260] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.960913 23206 ts_tablet_manager.cc:1428] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250109 21:10:56.960855 23203 raft_consensus.cc:357] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.961164 23204 raft_consensus.cc:357] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.961700 23203 raft_consensus.cc:383] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.961896 23204 raft_consensus.cc:383] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:56.962034 23203 raft_consensus.cc:738] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.962215 23206 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:56.962247 23204 raft_consensus.cc:738] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.962875 23203 consensus_queue.cc:260] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.963140 23204 consensus_queue.cc:260] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:56.965387 23203 ts_tablet_manager.cc:1428] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:10:56.965499 23204 ts_tablet_manager.cc:1428] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:10:56.966413 23203 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:56.966661 23204 tablet_bootstrap.cc:492] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:56.969024 23206 tablet_bootstrap.cc:654] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.970826 23207 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:56.971313 23207 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:56.972376 23203 tablet_bootstrap.cc:654] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.973318 23204 tablet_bootstrap.cc:654] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:56.981029 23206 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:56.981683 23206 ts_tablet_manager.cc:1397] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.020s user 0.005s sys 0.013s
I20250109 21:10:56.984980 23206 raft_consensus.cc:357] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:56.963516 23233 leader_election.cc:290] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.001578 23207 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:56.989006 23203 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:56.987054 23206 raft_consensus.cc:383] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.003065 23206 raft_consensus.cc:738] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.990511 23204 tablet_bootstrap.cc:492] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:57.003722 23204 ts_tablet_manager.cc:1397] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.037s user 0.022s sys 0.008s
I20250109 21:10:57.003839 23206 consensus_queue.cc:260] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.003204 23203 ts_tablet_manager.cc:1397] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.037s user 0.008s sys 0.024s
I20250109 21:10:57.006142 23206 ts_tablet_manager.cc:1428] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.024s user 0.008s sys 0.008s
I20250109 21:10:57.006831 23307 raft_consensus.cc:491] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.007109 23206 tablet_bootstrap.cc:492] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:57.007309 23307 raft_consensus.cc:513] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.007797 23204 raft_consensus.cc:357] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.008486 23204 raft_consensus.cc:383] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.008733 23204 raft_consensus.cc:738] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:56.999603 23383 raft_consensus.cc:491] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.009348 23204 consensus_queue.cc:260] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.009599 23383 raft_consensus.cc:513] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.012305 23204 ts_tablet_manager.cc:1428] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250109 21:10:57.012882 23383 leader_election.cc:290] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:57.013262 23206 tablet_bootstrap.cc:654] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.013262 23204 tablet_bootstrap.cc:492] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:57.028388 23204 tablet_bootstrap.cc:654] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.036142 23204 tablet_bootstrap.cc:492] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:57.036679 23204 ts_tablet_manager.cc:1397] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.002s
I20250109 21:10:57.008894 23307 leader_election.cc:290] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.040184 23204 raft_consensus.cc:357] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.041247 23204 raft_consensus.cc:383] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.041585 23204 raft_consensus.cc:738] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.042311 23204 consensus_queue.cc:260] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.043267 23203 raft_consensus.cc:357] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.044205 23203 raft_consensus.cc:383] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.044560 23203 raft_consensus.cc:738] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.044804 23204 ts_tablet_manager.cc:1428] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:57.046032 23204 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:57.047132 23220 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.047618 23220 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.047688 23203 consensus_queue.cc:260] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.049613 23220 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:57.052639 23204 tablet_bootstrap.cc:654] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.052999 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4b07d8e80744b782d3fb265f1d0ca7" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.053726 22935 raft_consensus.cc:2463] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:57.054119 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eaeb5702b8c4c15a530b7f4bc0b1990" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:57.054986 23084 raft_consensus.cc:3054] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.057865 23203 ts_tablet_manager.cc:1428] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.053s user 0.004s sys 0.003s
I20250109 21:10:57.059163 23203 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:57.059410 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.065112 23204 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:57.065806 23233 raft_consensus.cc:491] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.066251 23233 raft_consensus.cc:513] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.069725 23233 leader_election.cc:290] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.070866 23084 raft_consensus.cc:2463] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:57.079926 22976 leader_election.cc:304] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:57.080770 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0202de32424df98541f334960f7fe2" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.080927 23383 raft_consensus.cc:2743] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:57.081401 22933 raft_consensus.cc:2463] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:10:57.083580 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.084522 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2eaeb5702b8c4c15a530b7f4bc0b1990" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:57.087136 23011 raft_consensus.cc:3054] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.089982 22976 leader_election.cc:304] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:57.094491 23011 raft_consensus.cc:2463] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:57.096329 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:57.096992 23009 raft_consensus.cc:3054] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.100073 23405 raft_consensus.cc:2798] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.100498 23405 raft_consensus.cc:491] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.100806 23405 raft_consensus.cc:3054] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.102201 23124 leader_election.cc:304] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:57.104355 23009 raft_consensus.cc:2463] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:57.106020 23009 raft_consensus.cc:3054] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.107195 23386 consensus_queue.cc:1035] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:57.111147 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.111785 23011 raft_consensus.cc:2463] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:57.112800 23405 raft_consensus.cc:513] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.115470 23389 raft_consensus.cc:491] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.115942 23389 raft_consensus.cc:513] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.116339 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0202de32424df98541f334960f7fe2" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:57.116935 22935 raft_consensus.cc:3054] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.117936 23389 leader_election.cc:290] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:57.118588 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0202de32424df98541f334960f7fe2" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:57.119256 23158 raft_consensus.cc:3054] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.120079 22899 leader_election.cc:304] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:57.120951 23389 raft_consensus.cc:2798] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:57.121443 23389 raft_consensus.cc:695] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:57.122270 23389 consensus_queue.cc:237] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.124392 22935 raft_consensus.cc:2463] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:57.125249 23405 leader_election.cc:290] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:57.125689 22976 leader_election.cc:304] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:57.126541 23405 raft_consensus.cc:2798] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:57.126639 22899 leader_election.cc:304] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:57.127256 23405 raft_consensus.cc:695] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:10:57.128850 23405 consensus_queue.cc:237] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.129801 23279 raft_consensus.cc:2798] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:57.130259 23279 raft_consensus.cc:695] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:57.131698 23389 raft_consensus.cc:2798] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.131327 23279 consensus_queue.cc:237] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.132129 23389 raft_consensus.cc:491] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.132498 23389 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.131279 23158 raft_consensus.cc:2463] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:57.065595 23203 tablet_bootstrap.cc:654] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.140951 23207 consensus_queue.cc:1035] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:57.142663 23389 raft_consensus.cc:513] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.145587 23389 leader_election.cc:290] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.174993 23203 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:57.175669 23386 raft_consensus.cc:491] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.176308 23386 raft_consensus.cc:513] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.178653 23386 leader_election.cc:290] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:57.179427 23203 ts_tablet_manager.cc:1397] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.121s user 0.014s sys 0.015s
I20250109 21:10:57.179229 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ec0202de32424df98541f334960f7fe2" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.180105 23160 raft_consensus.cc:2371] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Already granted yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1. Re-sending same reply.
I20250109 21:10:57.182271 23005 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:57.183138 23005 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.182745 23203 raft_consensus.cc:357] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.184010 23203 raft_consensus.cc:383] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.184406 23203 raft_consensus.cc:738] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.185216 23203 consensus_queue.cc:260] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.188246 23203 ts_tablet_manager.cc:1428] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20250109 21:10:57.189424 23203 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:57.196514 23203 tablet_bootstrap.cc:654] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.065605 23204 ts_tablet_manager.cc:1397] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.008s
I20250109 21:10:57.203433 23202 consensus_queue.cc:260] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.209962 23157 raft_consensus.cc:3054] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.215453 23155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.216212 23155 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:57.218531 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4b07d8e80744b782d3fb265f1d0ca7" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:57.219372 22933 raft_consensus.cc:3054] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.221452 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb4bf7d44374f9d9d8dffad767ec200" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.222138 23003 raft_consensus.cc:2463] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:57.223119 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b4b07d8e80744b782d3fb265f1d0ca7" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:57.223762 23160 raft_consensus.cc:3054] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.228818 23155 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.229897 22933 raft_consensus.cc:2463] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:57.231899 23267 consensus_queue.cc:1035] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:57.232378 23008 raft_consensus.cc:3054] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.240360 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.233685 23204 raft_consensus.cc:357] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.246963 23204 raft_consensus.cc:383] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.247267 23204 raft_consensus.cc:738] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.247752 23268 consensus_queue.cc:1035] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:57.247875 23204 consensus_queue.cc:260] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.245033 23049 leader_election.cc:304] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:57.245494 23202 ts_tablet_manager.cc:1428] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.354s user 0.008s sys 0.002s
I20250109 21:10:57.250459 23202 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:57.256315 23206 tablet_bootstrap.cc:492] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:57.256785 23206 ts_tablet_manager.cc:1397] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.250s user 0.015s sys 0.042s
I20250109 21:10:57.256978 23202 tablet_bootstrap.cc:654] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.250283 22901 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
W20250109 21:10:57.244982 22899 leader_election.cc:343] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.266502 23233 raft_consensus.cc:2798] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:10:57.266898 23233 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.267259 23233 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:57.267875 23389 consensus_queue.cc:1035] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:57.277251 23384 raft_consensus.cc:2798] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.277618 23384 raft_consensus.cc:491] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.277925 23384 raft_consensus.cc:3054] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.278801 23206 raft_consensus.cc:357] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.286624 23206 raft_consensus.cc:383] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.287026 23206 raft_consensus.cc:738] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.288556 23218 consensus_queue.cc:1035] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:57.287758 23206 consensus_queue.cc:260] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.294046 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.295615 23159 raft_consensus.cc:2388] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:57.296999 22976 leader_election.cc:304] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:57.297484 22833 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38516 (request call id 39) took 1099 ms. Trace:
I20250109 21:10:57.295603 23206 ts_tablet_manager.cc:1428] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.039s user 0.003s sys 0.006s
I20250109 21:10:57.305295 23204 ts_tablet_manager.cc:1428] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.107s user 0.008s sys 0.000s
I20250109 21:10:57.313525 23204 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:57.319676 23005 raft_consensus.cc:2463] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:57.307276 23386 consensus_queue.cc:1035] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.014s
I20250109 21:10:57.322767 22899 leader_election.cc:304] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:57.325606 23268 raft_consensus.cc:491] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.326069 23268 raft_consensus.cc:513] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.328593 23268 leader_election.cc:290] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:57.310220 23233 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.297886 22833 rpcz_store.cc:276] 0109 21:10:56.198340 (+ 0us) service_pool.cc:168] Inserting onto call queue
0109 21:10:56.198496 (+ 156us) service_pool.cc:225] Handling call
0109 21:10:56.881008 (+682512us) write_op.cc:489] Releasing partition, row and schema locks
0109 21:10:56.881035 (+ 27us) write_op.cc:454] Released schema lock
0109 21:10:57.297394 (+416359us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0109 21:10:56.209312 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0109 21:10:56.209741 (+ 429us) write_op.cc:432] Acquiring schema lock in shared mode
0109 21:10:56.209770 (+ 29us) write_op.cc:435] Acquired schema lock
0109 21:10:56.209786 (+ 16us) tablet.cc:659] Decoding operations
0109 21:10:56.210063 (+ 277us) write_op.cc:620] Acquiring the partition lock for write op
0109 21:10:56.210112 (+ 49us) write_op.cc:641] Partition lock acquired for write op
0109 21:10:56.210135 (+ 23us) tablet.cc:682] Acquiring locks for 1 operations
0109 21:10:56.210335 (+ 200us) tablet.cc:698] Row locks acquired
0109 21:10:56.210359 (+ 24us) write_op.cc:260] PREPARE: finished
0109 21:10:56.210489 (+ 130us) write_op.cc:270] Start()
0109 21:10:56.210584 (+ 95us) write_op.cc:276] Timestamp: P: 1736457056210447 usec, L: 0
0109 21:10:56.210599 (+ 15us) op_driver.cc:348] REPLICATION: starting
0109 21:10:56.211107 (+ 508us) log.cc:844] Serialized 543 byte log entry
0109 21:10:56.212781 (+ 1674us) op_driver.cc:464] REPLICATION: finished
0109 21:10:56.213175 (+ 394us) write_op.cc:301] APPLY: starting
0109 21:10:56.213238 (+ 63us) tablet.cc:1364] starting BulkCheckPresence
0109 21:10:56.213332 (+ 94us) tablet.cc:1367] finished BulkCheckPresence
0109 21:10:56.213432 (+ 100us) tablet.cc:1369] starting ApplyRowOperation cycle
0109 21:10:56.213606 (+ 174us) tablet.cc:1380] finished ApplyRowOperation cycle
0109 21:10:56.213748 (+ 142us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0109 21:10:56.213792 (+ 44us) write_op.cc:312] APPLY: finished
0109 21:10:56.213950 (+ 158us) log.cc:844] Serialized 22 byte log entry
0109 21:10:56.214073 (+ 123us) write_op.cc:489] Releasing partition, row and schema locks
0109 21:10:56.214140 (+ 67us) write_op.cc:454] Released schema lock
0109 21:10:56.214180 (+ 40us) write_op.cc:341] FINISH: Updating metrics
Metrics: {"mutex_wait_us":221775,"reported_tablets":1,"child_traces":[["op",{"apply.queue_time_us":201,"apply.run_cpu_time_us":1235,"apply.run_wall_time_us":1235,"num_ops":1,"prepare.queue_time_us":108,"prepare.run_cpu_time_us":2026,"prepare.run_wall_time_us":2025,"replication_time_us":2085}]]}
W20250109 21:10:57.348740 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 57752.7us
I20250109 21:10:57.365404 23202 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:57.368033 23202 ts_tablet_manager.cc:1397] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.118s user 0.009s sys 0.008s
I20250109 21:10:57.359423 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27c19622df5416eb965291aeb863154" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.381134 23207 raft_consensus.cc:2798] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:57.390518 23382 raft_consensus.cc:491] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:10:57.391039 23298 raft_consensus.cc:2743] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:57.391359 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.391100 23382 raft_consensus.cc:513] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.394236 23206 tablet_bootstrap.cc:492] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:57.394613 23382 leader_election.cc:290] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.392220 23084 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:57.402276 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.403045 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.403759 23307 raft_consensus.cc:491] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.403952 22934 raft_consensus.cc:2388] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 2: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:57.404246 23307 raft_consensus.cc:513] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.407732 23233 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:57.408758 23233 consensus_queue.cc:1035] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:57.406718 23307 leader_election.cc:290] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:57.412883 23206 tablet_bootstrap.cc:654] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.413933 23384 raft_consensus.cc:513] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.415704 23279 raft_consensus.cc:491] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.398368 23202 raft_consensus.cc:357] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.417335 23202 raft_consensus.cc:383] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.417685 23202 raft_consensus.cc:738] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.406742 23204 tablet_bootstrap.cc:654] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.419765 23202 consensus_queue.cc:260] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:10:57.432395 23124 leader_election.cc:343] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.419971 23279 raft_consensus.cc:513] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.443814 23155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb4bf7d44374f9d9d8dffad767ec200" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:57.440869 22901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 50607.5us
I20250109 21:10:57.475639 23202 ts_tablet_manager.cc:1428] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.107s user 0.005s sys 0.003s
I20250109 21:10:57.450970 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27c19622df5416eb965291aeb863154" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.454530 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.455217 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.452647 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:57.481858 23268 raft_consensus.cc:491] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.499769 23203 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:57.490782 23389 raft_consensus.cc:491] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.500979 23203 ts_tablet_manager.cc:1397] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.312s user 0.061s sys 0.039s
I20250109 21:10:57.500980 23202 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:57.474169 23220 consensus_queue.cc:1035] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.023s
I20250109 21:10:57.495702 23085 raft_consensus.cc:3054] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.486974 23207 raft_consensus.cc:695] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:57.493855 22934 raft_consensus.cc:2463] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:57.497149 23233 raft_consensus.cc:491] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.493872 23126 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:57.507251 23267 raft_consensus.cc:491] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.500756 23160 raft_consensus.cc:2463] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:57.499306 23082 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:57.500387 23268 raft_consensus.cc:513] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.528424 23125 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:57.529481 23268 leader_election.cc:290] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.529980 23268 raft_consensus.cc:491] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.530390 23268 raft_consensus.cc:513] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.503543 23389 raft_consensus.cc:513] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.561779 23155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316cfec4ecf4f989132abc75c89a161" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.576939 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.577649 23377 raft_consensus.cc:491] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.578197 23377 raft_consensus.cc:513] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.580178 23377 leader_election.cc:290] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
W20250109 21:10:57.580400 22900 leader_election.cc:343] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.519191 23269 consensus_queue.cc:1035] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.020s
I20250109 21:10:57.517343 23233 raft_consensus.cc:513] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:10:57.583823 23422 log.cc:926] Time spent T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c: Append to log took a long time: real 0.071s user 0.000s sys 0.000s
I20250109 21:10:57.532081 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.593536 23421 raft_consensus.cc:491] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.594033 23421 raft_consensus.cc:513] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:10:57.594651 22900 leader_election.cc:343] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.569550 23220 raft_consensus.cc:2743] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:57.526819 23267 raft_consensus.cc:513] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.536347 23384 leader_election.cc:290] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:57.603907 23233 leader_election.cc:290] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:57.605283 23420 consensus_queue.cc:1035] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.010s
I20250109 21:10:57.569406 23051 leader_election.cc:304] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:57.606755 23204 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
W20250109 21:10:57.606942 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 45280.5us
I20250109 21:10:57.607029 23384 raft_consensus.cc:2798] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:57.607919 23384 raft_consensus.cc:695] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:57.607259 23204 ts_tablet_manager.cc:1397] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.294s user 0.025s sys 0.031s
I20250109 21:10:57.610069 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.609036 23384 consensus_queue.cc:237] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.592499 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
W20250109 21:10:57.621953 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:57.624204 23389 leader_election.cc:290] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:10:57.598534 23125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 71895.3us
I20250109 21:10:57.627010 23425 raft_consensus.cc:491] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.627566 23425 raft_consensus.cc:513] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.629590 23268 leader_election.cc:290] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:57.597304 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316cfec4ecf4f989132abc75c89a161" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.599948 23279 leader_election.cc:290] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
W20250109 21:10:57.637010 23418 log.cc:926] Time spent T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c: Append to log took a long time: real 0.131s user 0.001s sys 0.000s
I20250109 21:10:57.637706 23003 raft_consensus.cc:2463] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:57.601926 23083 raft_consensus.cc:2463] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:57.629601 23425 leader_election.cc:290] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.640288 23421 leader_election.cc:290] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:57.615209 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:57.635643 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.581557 23207 consensus_queue.cc:237] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.643868 23204 raft_consensus.cc:357] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.635388 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:57.647953 23204 raft_consensus.cc:383] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250109 21:10:57.635990 23426 log.cc:926] Time spent T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83: Append to log took a long time: real 0.134s user 0.001s sys 0.000s
I20250109 21:10:57.648628 23204 raft_consensus.cc:738] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.650027 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
W20250109 21:10:57.650405 22901 leader_election.cc:343] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.650956 22900 leader_election.cc:304] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:57.648456 23085 raft_consensus.cc:2463] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:57.652294 23080 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:57.656047 23404 consensus_queue.cc:1035] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.003s
I20250109 21:10:57.658620 23382 raft_consensus.cc:491] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.660884 23203 raft_consensus.cc:357] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.668644 23203 raft_consensus.cc:383] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.668916 23203 raft_consensus.cc:738] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.669070 23267 leader_election.cc:290] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:57.661892 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdcdd56a86d4793892b6a99883be239" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.662130 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb4bf7d44374f9d9d8dffad767ec200" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:57.665112 23202 tablet_bootstrap.cc:654] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:57.669005 22901 leader_election.cc:343] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.671743 22901 leader_election.cc:304] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:57.672066 23006 raft_consensus.cc:3054] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.670783 23382 raft_consensus.cc:513] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.675104 23382 leader_election.cc:290] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:57.675349 23429 raft_consensus.cc:2798] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.675918 23429 raft_consensus.cc:491] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.676292 23429 raft_consensus.cc:3054] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.679023 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:57.680121 22900 leader_election.cc:343] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.655452 23204 consensus_queue.cc:260] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.661016 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9657cd13da7346f3bc0bbe9be4cd54da" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.680035 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.681170 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fcdcdd56a86d4793892b6a99883be239" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:57.681677 22900 leader_election.cc:343] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.682024 23432 raft_consensus.cc:2798] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:10:57.682453 23432 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.682868 23432 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:10:57.682493 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.684593 23084 raft_consensus.cc:2463] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
W20250109 21:10:57.685339 23125 leader_election.cc:343] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.686059 23125 leader_election.cc:304] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:57.683837 23204 ts_tablet_manager.cc:1428] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.075s user 0.007s sys 0.000s
I20250109 21:10:57.669566 23203 consensus_queue.cc:260] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.688903 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9657cd13da7346f3bc0bbe9be4cd54da" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.689304 23204 tablet_bootstrap.cc:492] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:57.689832 23425 raft_consensus.cc:2743] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:57.690776 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.695067 23080 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:10:57.704988 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.709616 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.714511 23382 consensus_queue.cc:1035] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:57.715620 23206 tablet_bootstrap.cc:492] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:57.716348 23206 ts_tablet_manager.cc:1397] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.322s user 0.012s sys 0.032s
I20250109 21:10:57.717396 23421 raft_consensus.cc:491] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.717887 23421 raft_consensus.cc:513] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.717118 22976 leader_election.cc:304] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:57.719062 23206 raft_consensus.cc:357] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.719785 23421 leader_election.cc:290] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
W20250109 21:10:57.721241 23124 leader_election.cc:343] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.721765 23124 leader_election.cc:304] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:57.719961 23382 raft_consensus.cc:2743] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:57.722709 23220 raft_consensus.cc:2743] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:57.719803 23206 raft_consensus.cc:383] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.723454 23206 raft_consensus.cc:738] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.724097 23206 consensus_queue.cc:260] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
W20250109 21:10:57.724041 22976 leader_election.cc:343] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.727551 23206 ts_tablet_manager.cc:1428] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.011s user 0.007s sys 0.001s
I20250109 21:10:57.729053 22932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.729704 22932 raft_consensus.cc:2463] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:57.731285 23203 ts_tablet_manager.cc:1428] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.230s user 0.004s sys 0.002s
I20250109 21:10:57.733558 23204 tablet_bootstrap.cc:654] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.736722 23434 raft_consensus.cc:2798] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.737155 23434 raft_consensus.cc:491] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.737478 23434 raft_consensus.cc:3054] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.745527 23206 tablet_bootstrap.cc:492] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:57.752655 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:57.753986 23126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 271736us
I20250109 21:10:57.755755 23126 leader_election.cc:304] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:57.757630 23006 raft_consensus.cc:2463] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:57.758735 22932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.760859 22900 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:57.762871 23207 raft_consensus.cc:2798] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:10:57.762778 23203 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:57.768927 23433 raft_consensus.cc:2798] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.769366 23433 raft_consensus.cc:491] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.769711 23433 raft_consensus.cc:3054] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.776212 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:57.776899 23081 raft_consensus.cc:2463] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:10:57.778187 23049 leader_election.cc:304] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:57.779374 23421 raft_consensus.cc:2798] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:57.779747 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.780009 23421 raft_consensus.cc:695] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:57.780428 23007 raft_consensus.cc:2463] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:57.781090 23421 consensus_queue.cc:237] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.764217 23207 raft_consensus.cc:695] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:57.792791 23429 raft_consensus.cc:513] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:57.792551 23279 consensus_queue.cc:1035] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:57.795770 22833 catalog_manager.cc:5526] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:57.745399 23307 consensus_queue.cc:1035] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.039s
I20250109 21:10:57.799152 23220 consensus_queue.cc:1035] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.002s
I20250109 21:10:57.770289 22899 leader_election.cc:304] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:57.801512 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:57.799162 23207 consensus_queue.cc:237] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.818249 22932 raft_consensus.cc:2388] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:57.793622 23049 leader_election.cc:304] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:57.825804 23429 leader_election.cc:290] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.802807 22975 leader_election.cc:304] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:57.828871 23202 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:57.829388 23202 ts_tablet_manager.cc:1397] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.341s user 0.027s sys 0.002s
I20250109 21:10:57.832239 23202 raft_consensus.cc:357] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.832944 23202 raft_consensus.cc:383] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:57.833200 23202 raft_consensus.cc:738] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:57.835207 23404 raft_consensus.cc:2798] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.835690 23404 raft_consensus.cc:491] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.836028 23404 raft_consensus.cc:3054] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.823766 23425 raft_consensus.cc:2798] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.838385 23425 raft_consensus.cc:491] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.838816 23425 raft_consensus.cc:3054] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.835196 23204 tablet_bootstrap.cc:492] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:57.840847 23204 ts_tablet_manager.cc:1397] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.152s user 0.018s sys 0.007s
I20250109 21:10:57.843458 23268 raft_consensus.cc:491] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.801373 23051 leader_election.cc:304] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:57.841643 23202 consensus_queue.cc:260] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.849634 23203 tablet_bootstrap.cc:654] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:57.818552 22899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 154304us
I20250109 21:10:57.862197 23384 raft_consensus.cc:2798] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.844209 23268 raft_consensus.cc:513] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.869138 23202 ts_tablet_manager.cc:1428] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.039s user 0.009s sys 0.000s
W20250109 21:10:57.855369 23049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 67081.6us
I20250109 21:10:57.870239 23298 raft_consensus.cc:491] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.879741 23298 raft_consensus.cc:513] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.882313 23298 leader_election.cc:290] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:57.872939 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:57.873193 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
W20250109 21:10:57.873853 22901 leader_election.cc:343] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.866642 23267 raft_consensus.cc:2798] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:57.868132 23384 raft_consensus.cc:491] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250109 21:10:57.861348 23124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 62803.5us
W20250109 21:10:57.864171 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 66942.9us
I20250109 21:10:57.884258 23202 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:57.891445 23267 raft_consensus.cc:491] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:57.895745 23384 raft_consensus.cc:3054] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:57.911118 23051 leader_election.cc:343] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:57.879288 23434 raft_consensus.cc:513] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.878930 23433 raft_consensus.cc:513] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:57.895992 23233 consensus_queue.cc:1035] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.024s
I20250109 21:10:57.941634 23433 leader_election.cc:290] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:57.942459 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.943174 23434 leader_election.cc:290] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:57.915570 23267 raft_consensus.cc:3054] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.903656 22930 raft_consensus.cc:2463] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:57.908630 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb4bf7d44374f9d9d8dffad767ec200" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:57.949523 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
W20250109 21:10:57.950028 23446 log.cc:926] Time spent T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Append to log took a long time: real 0.066s user 0.000s sys 0.001s
I20250109 21:10:57.915266 23432 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:57.952348 23126 leader_election.cc:304] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:57.952873 23220 raft_consensus.cc:491] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:57.954259 23206 tablet_bootstrap.cc:654] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.954586 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.937238 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.972805 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:57.973431 23080 raft_consensus.cc:3054] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:57.974117 23160 raft_consensus.cc:2388] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 51679b9f547940b6a8311fd6fab340f7 in current term 2: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:10:57.974828 23432 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:57.970278 23159 raft_consensus.cc:2388] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:10:57.980938 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9657cd13da7346f3bc0bbe9be4cd54da" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:57.982131 23268 leader_election.cc:290] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
W20250109 21:10:57.983830 23049 leader_election.cc:343] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:10:57.959306 22901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 60467.5us
I20250109 21:10:57.970471 23220 raft_consensus.cc:513] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.993366 23220 leader_election.cc:290] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:57.997802 23202 tablet_bootstrap.cc:654] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:57.997948 23404 raft_consensus.cc:513] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.992584 23158 raft_consensus.cc:2463] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:58.000929 23204 raft_consensus.cc:357] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.005095 23456 raft_consensus.cc:491] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:58.005414 23204 raft_consensus.cc:383] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.005877 23204 raft_consensus.cc:738] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:58.002379 23425 raft_consensus.cc:513] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:58.007946 23204 consensus_queue.cc:260] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:57.979472 23433 raft_consensus.cc:2743] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250109 21:10:57.977746 22899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 91297us
W20250109 21:10:58.020872 23051 leader_election.cc:343] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.031785 23425 leader_election.cc:290] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:58.033337 23203 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:58.033843 23203 ts_tablet_manager.cc:1397] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.271s user 0.017s sys 0.004s
W20250109 21:10:58.019285 22901 leader_election.cc:343] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.042498 23204 ts_tablet_manager.cc:1428] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.201s user 0.003s sys 0.005s
I20250109 21:10:58.044099 23204 tablet_bootstrap.cc:492] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:58.016028 23456 raft_consensus.cc:513] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:10:58.053277 23051 leader_election.cc:343] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.055428 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27c19622df5416eb965291aeb863154" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:58.056915 23456 leader_election.cc:290] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
W20250109 21:10:58.071239 22976 leader_election.cc:343] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.056982 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27c19622df5416eb965291aeb863154" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
W20250109 21:10:58.076756 23181 debug-util.cc:398] Leaking SignalData structure 0x7b08000880c0 after lost signal to thread 20006
W20250109 21:10:58.080094 23181 debug-util.cc:398] Leaking SignalData structure 0x7b0800324320 after lost signal to thread 22867
W20250109 21:10:58.081694 23181 debug-util.cc:398] Leaking SignalData structure 0x7b080016cb20 after lost signal to thread 22959
I20250109 21:10:58.083333 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:58.084347 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:58.074757 22931 raft_consensus.cc:3054] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.099629 23204 tablet_bootstrap.cc:654] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:58.101583 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:58.102248 22930 raft_consensus.cc:3054] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.047902 22901 leader_election.cc:304] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
W20250109 21:10:58.100932 23181 debug-util.cc:398] Leaking SignalData structure 0x7b0800226bc0 after lost signal to thread 23035
I20250109 21:10:58.151535 23233 raft_consensus.cc:2743] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.175076 22932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:58.052572 22899 leader_election.cc:304] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:58.173969 23385 raft_consensus.cc:491] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:58.176831 23385 raft_consensus.cc:513] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.178181 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:58.179087 23006 raft_consensus.cc:2388] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 1: Already voted for candidate df8c84b03e6f4a5288bdad949ba2447c in this term.
I20250109 21:10:58.182161 23206 tablet_bootstrap.cc:492] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:58.183041 23206 ts_tablet_manager.cc:1397] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.438s user 0.023s sys 0.011s
I20250109 21:10:58.179695 23385 leader_election.cc:290] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:10:58.188668 23460 log.cc:926] Time spent T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83: Append to log took a long time: real 0.072s user 0.000s sys 0.000s
W20250109 21:10:58.185846 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 57747.3us
W20250109 21:10:58.188758 23181 debug-util.cc:398] Leaking SignalData structure 0x7b0800136560 after lost signal to thread 23110
W20250109 21:10:58.180437 23124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 64687.6us
I20250109 21:10:58.191924 23203 raft_consensus.cc:357] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:58.193457 23203 raft_consensus.cc:383] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.193699 23203 raft_consensus.cc:738] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
W20250109 21:10:58.182950 22901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 167830us
W20250109 21:10:58.197116 23455 log.cc:926] Time spent T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3: Append to log took a long time: real 0.170s user 0.001s sys 0.000s
I20250109 21:10:58.198580 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:58.186085 23456 raft_consensus.cc:2743] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:58.202174 23203 consensus_queue.cc:260] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:58.204988 23081 raft_consensus.cc:2388] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 2: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:10:58.207713 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:58.209107 22932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:58.212313 23158 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316cfec4ecf4f989132abc75c89a161" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:58.214864 22931 raft_consensus.cc:2463] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:58.215162 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:58.194239 23404 leader_election.cc:290] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:58.217029 23080 raft_consensus.cc:2463] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:58.218744 23203 ts_tablet_manager.cc:1428] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.185s user 0.009s sys 0.004s
I20250109 21:10:58.218606 23051 leader_election.cc:304] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:58.219790 23203 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:58.220914 23385 raft_consensus.cc:2743] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.221112 23267 raft_consensus.cc:513] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:58.222529 23085 raft_consensus.cc:2388] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 1: Already voted for candidate e1a492f3cf3a4827bb0045500a3abb83 in this term.
I20250109 21:10:58.223948 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:58.225299 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c762018d1be74ce190b41ebd28a2e93e" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:58.226022 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:58.227993 23125 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:58.229629 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:58.230459 23007 raft_consensus.cc:2388] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
W20250109 21:10:58.230788 23124 leader_election.cc:343] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.231240 23220 raft_consensus.cc:2743] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250109 21:10:58.231844 22900 leader_election.cc:304] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:58.232654 23458 raft_consensus.cc:2798] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:58.233150 23458 raft_consensus.cc:695] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:58.233950 23458 consensus_queue.cc:237] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.234246 23126 leader_election.cc:304] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:58.235229 23268 raft_consensus.cc:2798] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:58.235679 23268 raft_consensus.cc:695] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:58.235765 23206 raft_consensus.cc:357] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.237543 23206 raft_consensus.cc:383] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.236527 23268 consensus_queue.cc:237] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:10:58.190573 22899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 151991us
I20250109 21:10:58.183825 23384 raft_consensus.cc:513] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.238044 23206 raft_consensus.cc:738] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:58.243186 23206 consensus_queue.cc:260] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.244799 23204 tablet_bootstrap.cc:492] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:58.245273 23204 ts_tablet_manager.cc:1397] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.201s user 0.012s sys 0.026s
I20250109 21:10:58.249706 23084 raft_consensus.cc:2388] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate e1a492f3cf3a4827bb0045500a3abb83 in this term.
I20250109 21:10:58.253140 23206 ts_tablet_manager.cc:1428] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.070s user 0.008s sys 0.000s
I20250109 21:10:58.253257 23384 leader_election.cc:290] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:58.254449 23206 tablet_bootstrap.cc:492] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:58.255492 23202 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:58.256088 23202 ts_tablet_manager.cc:1397] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.385s user 0.025s sys 0.026s
W20250109 21:10:58.250411 23181 debug-util.cc:398] Leaking SignalData structure 0x7b0800322660 after lost signal to thread 23184
I20250109 21:10:58.260473 23467 consensus_queue.cc:1035] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.006s
W20250109 21:10:58.238175 23451 log.cc:926] Time spent T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Append to log took a long time: real 0.107s user 0.000s sys 0.004s
I20250109 21:10:58.266085 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:58.266943 23157 raft_consensus.cc:3054] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.236598 23203 tablet_bootstrap.cc:654] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:58.276548 23125 leader_election.cc:304] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
W20250109 21:10:58.278343 23463 log.cc:926] Time spent T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
W20250109 21:10:58.263262 22899 leader_election.cc:343] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.287483 23204 raft_consensus.cc:357] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.296159 23204 raft_consensus.cc:383] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.296572 23204 raft_consensus.cc:738] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:58.297463 23204 consensus_queue.cc:260] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.299446 23125 leader_election.cc:304] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:58.303336 23204 ts_tablet_manager.cc:1428] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.058s user 0.008s sys 0.001s
I20250109 21:10:58.292245 22899 leader_election.cc:304] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
W20250109 21:10:58.305613 22899 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 47141.5us
W20250109 21:10:58.306627 22899 leader_election.cc:343] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.310343 23267 leader_election.cc:290] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:58.311398 23207 raft_consensus.cc:2743] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:58.311815 22900 leader_election.cc:343] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.313808 23202 raft_consensus.cc:357] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.314605 23202 raft_consensus.cc:383] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.318753 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:58.320277 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316cfec4ecf4f989132abc75c89a161" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:58.320887 23006 raft_consensus.cc:3054] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.318768 23049 leader_election.cc:304] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:58.323444 23204 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:58.325191 23202 raft_consensus.cc:738] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:58.325737 23202 consensus_queue.cc:260] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.329859 23206 tablet_bootstrap.cc:654] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:58.302673 23433 raft_consensus.cc:2743] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:10:58.327733 23269 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.339191 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
W20250109 21:10:58.339695 22901 leader_election.cc:343] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.340047 23160 raft_consensus.cc:2388] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:10:58.343703 23202 ts_tablet_manager.cc:1428] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.087s user 0.007s sys 0.000s
I20250109 21:10:58.344446 22929 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "575f5547ec354edc8ac999aec2222318" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:58.344624 22935 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9657cd13da7346f3bc0bbe9be4cd54da" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:58.349037 23382 raft_consensus.cc:491] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:58.354121 23473 log.cc:926] Time spent T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3: Append to log took a long time: real 0.061s user 0.000s sys 0.000s
I20250109 21:10:58.351976 22935 raft_consensus.cc:2463] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:10:58.355247 23267 consensus_queue.cc:1035] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:58.353951 23157 raft_consensus.cc:2463] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:58.328624 22930 raft_consensus.cc:2463] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:58.349570 23382 raft_consensus.cc:513] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.359643 23268 raft_consensus.cc:2743] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.362612 23382 leader_election.cc:290] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:58.363119 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:58.363425 23006 raft_consensus.cc:2463] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:58.363982 23009 raft_consensus.cc:2388] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate df8c84b03e6f4a5288bdad949ba2447c in this term.
I20250109 21:10:58.385787 22899 leader_election.cc:304] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:58.387877 22976 leader_election.cc:304] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:58.394357 23049 leader_election.cc:304] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:58.395859 23389 raft_consensus.cc:2798] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:58.373769 23126 leader_election.cc:304] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:10:58.398165 23405 raft_consensus.cc:2798] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:58.398603 23405 raft_consensus.cc:491] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:58.398962 23405 raft_consensus.cc:3054] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.396557 23384 raft_consensus.cc:2743] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.401552 23389 raft_consensus.cc:695] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:58.402484 23389 consensus_queue.cc:237] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:58.404974 23269 raft_consensus.cc:2743] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.405251 23204 tablet_bootstrap.cc:654] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:58.376770 23051 leader_election.cc:343] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.398177 23458 consensus_queue.cc:1035] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:58.410612 23220 raft_consensus.cc:2798] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:58.411263 22976 leader_election.cc:304] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:10:58.422013 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c762018d1be74ce190b41ebd28a2e93e" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:58.426416 22899 leader_election.cc:343] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.426931 22899 leader_election.cc:304] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:58.418025 23051 leader_election.cc:304] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:58.442843 23377 raft_consensus.cc:2743] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:58.445219 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 76961.6us
I20250109 21:10:58.439723 23382 raft_consensus.cc:2798] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:58.448110 23405 raft_consensus.cc:513] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:58.448514 23382 raft_consensus.cc:695] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:10:58.450958 23267 consensus_queue.cc:1035] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:58.450461 23382 consensus_queue.cc:237] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.451215 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:58.453378 23051 leader_election.cc:304] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:58.453377 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:58.454464 22976 leader_election.cc:343] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.455744 23152 raft_consensus.cc:3054] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.429111 23389 raft_consensus.cc:2743] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.428741 23220 raft_consensus.cc:695] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:58.457618 23385 raft_consensus.cc:2743] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.459347 23267 raft_consensus.cc:491] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:58.459820 23084 raft_consensus.cc:1270] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250109 21:10:58.471046 23267 raft_consensus.cc:513] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.472713 23307 consensus_queue.cc:1035] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:58.474501 23458 consensus_queue.cc:1035] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250109 21:10:58.479877 22975 leader_election.cc:343] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.482378 22975 leader_election.cc:304] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:58.482874 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9657cd13da7346f3bc0bbe9be4cd54da" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:58.483237 23383 raft_consensus.cc:2743] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.482688 23405 leader_election.cc:290] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:58.483422 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "9657cd13da7346f3bc0bbe9be4cd54da" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:58.484627 22933 raft_consensus.cc:3054] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.484972 23267 leader_election.cc:290] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
W20250109 21:10:58.485857 22976 leader_election.cc:343] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.471477 23220 consensus_queue.cc:237] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:58.495559 23011 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:58.497112 23049 leader_election.cc:343] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.501245 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:58.502008 23157 raft_consensus.cc:2463] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:58.502125 23389 raft_consensus.cc:491] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:58.502249 22933 raft_consensus.cc:2463] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:58.502723 23389 raft_consensus.cc:513] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:58.503429 23051 leader_election.cc:304] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:58.504412 23269 raft_consensus.cc:2798] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:58.504822 23269 raft_consensus.cc:491] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:58.504943 23389 leader_election.cc:290] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:58.505250 23269 raft_consensus.cc:3054] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.506646 22976 leader_election.cc:304] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:58.507615 23202 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:58.508925 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e82f7c977e4539b1368607513bc151" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:58.510543 22901 leader_election.cc:343] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.512130 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e82f7c977e4539b1368607513bc151" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:58.513602 22899 leader_election.cc:343] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.514026 23202 tablet_bootstrap.cc:654] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:58.514142 22899 leader_election.cc:304] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:58.515614 23389 raft_consensus.cc:2743] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:58.517474 23434 raft_consensus.cc:491] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:58.518177 23405 raft_consensus.cc:2798] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:58.518066 23434 raft_consensus.cc:513] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.518846 23405 raft_consensus.cc:695] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:10:58.519997 23405 consensus_queue.cc:237] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:58.524117 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb4bf7d44374f9d9d8dffad767ec200" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:58.522900 23434 leader_election.cc:290] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:58.523268 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb4bf7d44374f9d9d8dffad767ec200" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:58.536878 23269 raft_consensus.cc:513] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.559435 23385 consensus_queue.cc:1035] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:58.595155 23124 leader_election.cc:304] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:58.597158 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:58.597857 23157 raft_consensus.cc:3054] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:58.583746 23269 leader_election.cc:290] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:58.600490 23434 raft_consensus.cc:2743] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250109 21:10:58.612952 23479 log.cc:926] Time spent T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3: Append to log took a long time: real 0.056s user 0.001s sys 0.000s
I20250109 21:10:58.613313 23160 raft_consensus.cc:1270] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 1. (index mismatch)
I20250109 21:10:58.614886 23389 consensus_queue.cc:1035] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:58.618539 23206 tablet_bootstrap.cc:492] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:58.619067 23206 ts_tablet_manager.cc:1397] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.365s user 0.015s sys 0.032s
I20250109 21:10:58.624868 23206 raft_consensus.cc:357] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.625512 23206 raft_consensus.cc:383] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.625691 23206 raft_consensus.cc:738] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:58.626153 23206 consensus_queue.cc:260] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.609452 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:58.633810 23206 ts_tablet_manager.cc:1428] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.014s user 0.005s sys 0.000s
I20250109 21:10:58.637095 23204 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:58.637565 23204 ts_tablet_manager.cc:1397] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.314s user 0.024s sys 0.013s
I20250109 21:10:58.633757 22829 catalog_manager.cc:5526] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:58.644093 23206 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:58.679386 23203 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:58.680323 23203 ts_tablet_manager.cc:1397] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.461s user 0.017s sys 0.010s
W20250109 21:10:58.688751 22899 consensus_peers.cc:487] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:58.678680 23049 leader_election.cc:343] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.700508 23204 raft_consensus.cc:357] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.701359 23204 raft_consensus.cc:383] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.701707 23204 raft_consensus.cc:738] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:58.702564 23204 consensus_queue.cc:260] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.707439 23434 consensus_queue.cc:1035] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250109 21:10:58.727594 23487 log.cc:926] Time spent T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
W20250109 21:10:58.736445 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 50710.6us
W20250109 21:10:58.737310 23124 consensus_peers.cc:487] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:58.710181 23203 raft_consensus.cc:357] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.755407 23203 raft_consensus.cc:383] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.755908 23203 raft_consensus.cc:738] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:58.756951 23203 consensus_queue.cc:260] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.762290 23203 ts_tablet_manager.cc:1428] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.082s user 0.007s sys 0.002s
I20250109 21:10:58.776294 23204 ts_tablet_manager.cc:1428] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.138s user 0.008s sys 0.000s
I20250109 21:10:58.779233 22829 rpcz_store.cc:275] Call kudu.master.MasterService.TSHeartbeat from 127.0.0.1:38530 (request call id 47) took 1140 ms. Trace:
I20250109 21:10:58.780634 22831 catalog_manager.cc:5526] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:58.787178 23203 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:58.788789 23204 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:58.789148 22831 catalog_manager.cc:5526] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:58.792893 22831 catalog_manager.cc:5526] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 2, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:58.778383 23157 raft_consensus.cc:2463] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:58.786671 23385 raft_consensus.cc:491] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:58.779695 22829 rpcz_store.cc:276] 0109 21:10:57.639109 (+ 0us) service_pool.cc:168] Inserting onto call queue
0109 21:10:57.639255 (+ 146us) service_pool.cc:225] Handling call
0109 21:10:58.779158 (+1139903us) inbound_call.cc:173] Queueing success response
Related trace 'op':
0109 21:10:58.647904 (+ 0us) write_op.cc:183] PREPARE: starting on tablet 00000000000000000000000000000000
0109 21:10:58.648359 (+ 455us) write_op.cc:432] Acquiring schema lock in shared mode
0109 21:10:58.648393 (+ 34us) write_op.cc:435] Acquired schema lock
0109 21:10:58.648405 (+ 12us) tablet.cc:659] Decoding operations
0109 21:10:58.648732 (+ 327us) write_op.cc:620] Acquiring the partition lock for write op
0109 21:10:58.648787 (+ 55us) write_op.cc:641] Partition lock acquired for write op
0109 21:10:58.648810 (+ 23us) tablet.cc:682] Acquiring locks for 1 operations
0109 21:10:58.648980 (+ 170us) tablet.cc:698] Row locks acquired
0109 21:10:58.648995 (+ 15us) write_op.cc:260] PREPARE: finished
0109 21:10:58.649128 (+ 133us) write_op.cc:270] Start()
0109 21:10:58.649236 (+ 108us) write_op.cc:276] Timestamp: P: 1736457058649090 usec, L: 0
0109 21:10:58.649254 (+ 18us) op_driver.cc:348] REPLICATION: starting
0109 21:10:58.649784 (+ 530us) log.cc:844] Serialized 543 byte log entry
0109 21:10:58.688026 (+ 38242us) op_driver.cc:464] REPLICATION: finished
0109 21:10:58.700829 (+ 12803us) write_op.cc:301] APPLY: starting
0109 21:10:58.700938 (+ 109us) tablet.cc:1364] starting BulkCheckPresence
0109 21:10:58.701066 (+ 128us) tablet.cc:1367] finished BulkCheckPresence
0109 21:10:58.701197 (+ 131us) tablet.cc:1369] starting ApplyRowOperation cycle
0109 21:10:58.701509 (+ 312us) tablet.cc:1380] finished ApplyRowOperation cycle
0109 21:10:58.701715 (+ 206us) tablet_metrics.cc:563] ProbeStats: bloom_lookups=0,key_file_lookups=0,delta_file_lookups=0,mrs_lookups=1
0109 21:10:58.701779 (+ 64us) write_op.cc:312] APPLY: finished
0109 21:10:58.701999 (+ 220us) log.cc:844] Serialized 22 byte log entry
0109 21:10:58.702871 (+ 872us) write_op.cc:489] Releasing partition, row and schema locks
0109 21:10:58.702993 (+ 122us) write_op.cc:454] Released schema lock
0109 21:10:58.703044 (+ 51us) write_op.cc:341] FINISH: Updating metrics
0109 21:10:58.703425 (+ 381us) write_op.cc:489] Releasing partition, row and schema locks
0109 21:10:58.703475 (+ 50us) write_op.cc:454] Released schema lock
Metrics: {"mutex_wait_us":5665,"reported_tablets":7,"child_traces":[["op",{"apply.queue_time_us":12530,"apply.run_cpu_time_us":1887,"apply.run_wall_time_us":2557,"num_ops":1,"prepare.queue_time_us":917,"prepare.run_cpu_time_us":2110,"prepare.run_wall_time_us":2110,"replication_time_us":34410}]]}
W20250109 21:10:58.824002 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:10:58.842145 23202 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:58.842659 23202 ts_tablet_manager.cc:1397] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.335s user 0.001s sys 0.017s
I20250109 21:10:58.812636 23385 raft_consensus.cc:513] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:58.856284 23204 tablet_bootstrap.cc:654] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:58.861685 23202 raft_consensus.cc:357] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.862246 23202 raft_consensus.cc:383] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:58.862470 23202 raft_consensus.cc:738] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:58.865381 23202 consensus_queue.cc:260] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:58.888144 23202 ts_tablet_manager.cc:1428] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.045s user 0.005s sys 0.002s
W20250109 21:10:58.892730 23486 log.cc:926] Time spent T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c: Append to log took a long time: real 0.094s user 0.001s sys 0.000s
I20250109 21:10:58.895423 23385 leader_election.cc:290] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:58.897128 23307 consensus_queue.cc:1035] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:58.904839 23202 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:58.925587 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c859bd141e74dbd810b500fd5244d26" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:58.936336 23268 raft_consensus.cc:491] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:58.936883 23268 raft_consensus.cc:513] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
W20250109 21:10:58.939204 22901 consensus_peers.cc:487] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 -> Peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Couldn't send request to peer 227e48f30ae84db6bff43cc2860219a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:10:58.941766 23496 log.cc:926] Time spent T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Append to log took a long time: real 0.075s user 0.000s sys 0.000s
I20250109 21:10:58.945847 23405 consensus_queue.cc:1035] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:58.950416 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c859bd141e74dbd810b500fd5244d26" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:58.951881 23124 leader_election.cc:343] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.902136 23051 leader_election.cc:304] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
W20250109 21:10:58.954129 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 67932.7us
I20250109 21:10:58.955013 23268 leader_election.cc:290] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:58.955981 23457 consensus_queue.cc:1035] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:58.958214 23269 raft_consensus.cc:2798] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:58.959401 23269 raft_consensus.cc:695] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:58.960801 23202 tablet_bootstrap.cc:654] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:58.960506 23269 consensus_queue.cc:237] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
W20250109 21:10:58.959115 23049 leader_election.cc:343] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:58.967762 22830 catalog_manager.cc:5526] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:58.972141 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c859bd141e74dbd810b500fd5244d26" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:58.972851 23084 raft_consensus.cc:2463] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:58.973843 23125 leader_election.cc:304] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:58.982683 23203 tablet_bootstrap.cc:654] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:58.986447 23206 tablet_bootstrap.cc:654] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:58.980011 23268 raft_consensus.cc:2798] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:58.990057 22830 catalog_manager.cc:5526] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:58.988852 23268 raft_consensus.cc:491] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250109 21:10:58.998255 22976 consensus_peers.cc:487] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c -> Peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Couldn't send request to peer 227e48f30ae84db6bff43cc2860219a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:59.000078 23268 raft_consensus.cc:3054] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.006788 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c859bd141e74dbd810b500fd5244d26" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.019181 23279 consensus_queue.cc:1035] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:59.027335 23405 consensus_queue.cc:1035] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:59.031996 23457 raft_consensus.cc:491] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.032509 23457 raft_consensus.cc:513] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.034463 23457 leader_election.cc:290] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:59.038106 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.037514 22829 catalog_manager.cc:5526] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.038821 23085 raft_consensus.cc:2463] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:59.040135 22900 leader_election.cc:304] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:59.040980 23307 raft_consensus.cc:2798] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:59.041414 23307 raft_consensus.cc:491] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:59.041790 23307 raft_consensus.cc:3054] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.042455 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:59.043308 23009 raft_consensus.cc:2463] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
I20250109 21:10:59.039731 22829 catalog_manager.cc:5526] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:59.062501 23204 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:59.063112 23204 ts_tablet_manager.cc:1397] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.279s user 0.011s sys 0.008s
I20250109 21:10:59.067170 23383 consensus_queue.cc:1035] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:59.069785 23279 consensus_queue.cc:1035] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:59.072468 22833 catalog_manager.cc:5526] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.074673 22833 catalog_manager.cc:5526] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.084407 23203 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.084986 23203 ts_tablet_manager.cc:1397] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.298s user 0.017s sys 0.000s
I20250109 21:10:59.090402 23206 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:59.090967 23206 ts_tablet_manager.cc:1397] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.447s user 0.018s sys 0.000s
I20250109 21:10:59.092433 23268 raft_consensus.cc:513] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.095162 23152 raft_consensus.cc:2388] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:10:59.097184 23307 raft_consensus.cc:513] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.098713 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c859bd141e74dbd810b500fd5244d26" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
W20250109 21:10:59.099989 23124 leader_election.cc:343] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.100288 23051 leader_election.cc:304] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:59.101572 23497 raft_consensus.cc:3054] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.094516 23268 leader_election.cc:290] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:59.104122 23204 raft_consensus.cc:357] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.104867 23204 raft_consensus.cc:383] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.104898 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:59.105239 23204 raft_consensus.cc:738] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.105546 23009 raft_consensus.cc:3054] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.105986 23204 consensus_queue.cc:260] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.105940 23307 leader_election.cc:290] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:59.108736 23204 ts_tablet_manager.cc:1428] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.045s user 0.002s sys 0.004s
I20250109 21:10:59.109828 23204 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:59.109082 22831 catalog_manager.cc:5526] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.105229 23203 raft_consensus.cc:357] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.111486 23203 raft_consensus.cc:383] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.111047 22831 catalog_manager.cc:5526] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.113145 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:59.112460 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c859bd141e74dbd810b500fd5244d26" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:59.113724 23080 raft_consensus.cc:3054] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.111745 23203 raft_consensus.cc:738] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.112390 23206 raft_consensus.cc:357] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.124886 23206 raft_consensus.cc:383] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.117231 23203 consensus_queue.cc:260] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.125195 23206 raft_consensus.cc:738] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.131703 23206 consensus_queue.cc:260] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.148451 23203 ts_tablet_manager.cc:1428] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.063s user 0.007s sys 0.000s
I20250109 21:10:59.150313 23457 raft_consensus.cc:491] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.152063 23202 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:59.152694 23202 ts_tablet_manager.cc:1397] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.253s user 0.011s sys 0.004s
I20250109 21:10:59.154558 23206 ts_tablet_manager.cc:1428] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.063s user 0.006s sys 0.000s
I20250109 21:10:59.149963 23080 raft_consensus.cc:2463] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:10:59.152020 23457 raft_consensus.cc:513] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.159114 22830 catalog_manager.cc:5526] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.161077 23203 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.161429 22900 leader_election.cc:304] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:59.162143 23420 raft_consensus.cc:2798] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:59.162604 23420 raft_consensus.cc:695] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:10:59.163407 23420 consensus_queue.cc:237] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.168694 23203 tablet_bootstrap.cc:654] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.163403 23008 raft_consensus.cc:3054] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.174427 23457 leader_election.cc:290] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:59.175628 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbd7a89d4ce745659bb16e1e800506ba" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:59.181206 23202 raft_consensus.cc:357] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.181969 23202 raft_consensus.cc:383] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.182245 23202 raft_consensus.cc:738] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.155709 23009 raft_consensus.cc:2463] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
W20250109 21:10:59.183029 22899 leader_election.cc:343] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.182878 23202 consensus_queue.cc:260] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.193368 23206 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:59.204725 23497 raft_consensus.cc:2743] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:59.206300 23202 ts_tablet_manager.cc:1428] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.053s user 0.006s sys 0.000s
I20250109 21:10:59.213732 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbd7a89d4ce745659bb16e1e800506ba" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:59.215557 22901 leader_election.cc:343] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.215993 22901 leader_election.cc:304] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:59.219101 23457 raft_consensus.cc:2743] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:59.224272 23083 raft_consensus.cc:2463] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:59.225930 23202 tablet_bootstrap.cc:492] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:59.227452 23125 leader_election.cc:304] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:59.228689 23268 raft_consensus.cc:2798] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:59.229128 23268 raft_consensus.cc:695] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:59.229925 23268 consensus_queue.cc:237] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.241421 23204 tablet_bootstrap.cc:654] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.268901 23206 tablet_bootstrap.cc:654] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.273084 23203 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.274175 23203 ts_tablet_manager.cc:1397] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.115s user 0.048s sys 0.042s
I20250109 21:10:59.275329 23202 tablet_bootstrap.cc:654] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.276988 23457 raft_consensus.cc:491] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.277498 23457 raft_consensus.cc:513] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.281518 22831 catalog_manager.cc:5526] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } }
I20250109 21:10:59.286356 22830 catalog_manager.cc:5526] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.289633 23457 leader_election.cc:290] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:59.291113 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:59.292634 22900 leader_election.cc:343] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.293509 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.293776 23160 raft_consensus.cc:3054] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:59.294926 22901 leader_election.cc:343] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.295353 22901 leader_election.cc:304] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:59.296387 23307 raft_consensus.cc:2743] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:59.301810 23203 raft_consensus.cc:357] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.302542 23203 raft_consensus.cc:383] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.302815 23203 raft_consensus.cc:738] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.303490 23203 consensus_queue.cc:260] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.306839 23203 ts_tablet_manager.cc:1428] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.032s user 0.001s sys 0.005s
I20250109 21:10:59.307725 23203 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.308532 23204 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:59.309032 23204 ts_tablet_manager.cc:1397] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.199s user 0.006s sys 0.005s
I20250109 21:10:59.314356 23203 tablet_bootstrap.cc:654] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.317626 23202 tablet_bootstrap.cc:492] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:59.318132 23202 ts_tablet_manager.cc:1397] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.111s user 0.011s sys 0.000s
I20250109 21:10:59.321889 23202 raft_consensus.cc:357] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.324483 23204 raft_consensus.cc:357] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.325543 23204 raft_consensus.cc:383] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.325884 23204 raft_consensus.cc:738] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.326838 23204 consensus_queue.cc:260] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.330225 23204 ts_tablet_manager.cc:1428] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.021s user 0.008s sys 0.001s
I20250109 21:10:59.322820 23202 raft_consensus.cc:383] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.330727 23202 raft_consensus.cc:738] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.351148 23202 consensus_queue.cc:260] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.369508 23204 tablet_bootstrap.cc:492] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:59.372404 23206 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:59.372960 23206 ts_tablet_manager.cc:1397] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.213s user 0.023s sys 0.042s
I20250109 21:10:59.375272 23203 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.375945 23203 ts_tablet_manager.cc:1397] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.068s user 0.018s sys 0.030s
I20250109 21:10:59.378944 23203 raft_consensus.cc:357] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.379851 23203 raft_consensus.cc:383] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.380179 23203 raft_consensus.cc:738] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.375495 23206 raft_consensus.cc:357] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.380705 23206 raft_consensus.cc:383] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.381003 23206 raft_consensus.cc:738] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.381691 23206 consensus_queue.cc:260] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.381263 23203 consensus_queue.cc:260] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.384330 23206 ts_tablet_manager.cc:1428] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.011s user 0.007s sys 0.001s
I20250109 21:10:59.384802 23203 ts_tablet_manager.cc:1428] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250109 21:10:59.385751 23206 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:59.385825 23203 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.391996 23206 tablet_bootstrap.cc:654] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.392335 23203 tablet_bootstrap.cc:654] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.400595 23203 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.401098 23203 ts_tablet_manager.cc:1397] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.015s user 0.014s sys 0.000s
I20250109 21:10:59.403337 23204 tablet_bootstrap.cc:654] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.403826 23203 raft_consensus.cc:357] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.404656 23203 raft_consensus.cc:383] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.380337 23202 ts_tablet_manager.cc:1428] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.062s user 0.006s sys 0.000s
I20250109 21:10:59.404966 23203 raft_consensus.cc:738] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.406522 23202 tablet_bootstrap.cc:492] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:59.406750 23203 consensus_queue.cc:260] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.409245 23203 ts_tablet_manager.cc:1428] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250109 21:10:59.410307 23203 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.414954 23206 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:59.415477 23206 ts_tablet_manager.cc:1397] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.030s user 0.010s sys 0.008s
I20250109 21:10:59.416023 23203 tablet_bootstrap.cc:654] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.418094 23206 raft_consensus.cc:357] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.418895 23206 raft_consensus.cc:383] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.419231 23206 raft_consensus.cc:738] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.419940 23206 consensus_queue.cc:260] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.422190 23206 ts_tablet_manager.cc:1428] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:10:59.423153 23206 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:59.436729 23206 tablet_bootstrap.cc:654] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.443269 23202 tablet_bootstrap.cc:654] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.459267 23202 tablet_bootstrap.cc:492] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:59.459872 23202 ts_tablet_manager.cc:1397] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.054s user 0.012s sys 0.002s
I20250109 21:10:59.460445 23204 tablet_bootstrap.cc:492] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:10:59.461071 23204 ts_tablet_manager.cc:1397] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.092s user 0.014s sys 0.001s
I20250109 21:10:59.462466 23202 raft_consensus.cc:357] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.463285 23202 raft_consensus.cc:383] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.464421 23204 raft_consensus.cc:357] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.465427 23204 raft_consensus.cc:383] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.465694 23204 raft_consensus.cc:738] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.466164 23203 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.466380 23204 consensus_queue.cc:260] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.466985 23203 ts_tablet_manager.cc:1397] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.057s user 0.020s sys 0.027s
I20250109 21:10:59.469537 23203 raft_consensus.cc:357] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.470232 23203 raft_consensus.cc:383] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.470492 23203 raft_consensus.cc:738] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.471275 23203 consensus_queue.cc:260] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.474969 23203 ts_tablet_manager.cc:1428] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:10:59.463572 23202 raft_consensus.cc:738] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.475836 23202 consensus_queue.cc:260] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.478101 23202 ts_tablet_manager.cc:1428] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.018s user 0.006s sys 0.000s
I20250109 21:10:59.480945 23203 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.483366 23202 tablet_bootstrap.cc:492] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:59.486989 23383 raft_consensus.cc:491] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.487648 23383 raft_consensus.cc:513] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.489259 23202 tablet_bootstrap.cc:654] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.491638 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c859bd141e74dbd810b500fd5244d26" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.493162 23383 leader_election.cc:290] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:59.495880 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "0c859bd141e74dbd810b500fd5244d26" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.496948 23083 raft_consensus.cc:2388] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:10:59.497170 23203 tablet_bootstrap.cc:654] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.498394 22975 leader_election.cc:304] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:59.501454 23206 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:59.501971 23206 ts_tablet_manager.cc:1397] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.079s user 0.033s sys 0.023s
I20250109 21:10:59.504717 23206 raft_consensus.cc:357] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.505473 23206 raft_consensus.cc:383] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.505774 23206 raft_consensus.cc:738] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.506522 23206 consensus_queue.cc:260] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.509564 23203 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.509867 23405 raft_consensus.cc:3054] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.510375 23203 ts_tablet_manager.cc:1397] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.030s user 0.009s sys 0.003s
I20250109 21:10:59.514521 23202 tablet_bootstrap.cc:492] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:59.511754 23206 ts_tablet_manager.cc:1428] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.009s user 0.005s sys 0.000s
I20250109 21:10:59.514326 23203 raft_consensus.cc:357] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.515060 23202 ts_tablet_manager.cc:1397] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.032s user 0.013s sys 0.001s
I20250109 21:10:59.516021 23206 tablet_bootstrap.cc:492] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:59.517827 23202 raft_consensus.cc:357] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.518536 23202 raft_consensus.cc:383] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.518818 23202 raft_consensus.cc:738] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.518546 23203 raft_consensus.cc:383] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.519654 23203 raft_consensus.cc:738] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.520267 23203 consensus_queue.cc:260] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.521266 23202 consensus_queue.cc:260] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.522289 23206 tablet_bootstrap.cc:654] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.523656 23203 ts_tablet_manager.cc:1428] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.012s user 0.004s sys 0.002s
I20250109 21:10:59.524631 23203 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.530055 23203 tablet_bootstrap.cc:654] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.532591 23382 raft_consensus.cc:491] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.532711 23385 raft_consensus.cc:491] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.533099 23382 raft_consensus.cc:513] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.533239 23385 raft_consensus.cc:513] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.533990 23206 tablet_bootstrap.cc:492] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:59.534504 23206 ts_tablet_manager.cc:1397] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.019s user 0.016s sys 0.000s
I20250109 21:10:59.535144 23382 leader_election.cc:290] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:59.536074 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c762018d1be74ce190b41ebd28a2e93e" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:59.536288 23385 leader_election.cc:290] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:59.536788 22933 raft_consensus.cc:2463] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:59.537647 23202 ts_tablet_manager.cc:1428] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.022s user 0.005s sys 0.000s
I20250109 21:10:59.537439 23206 raft_consensus.cc:357] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.538391 23206 raft_consensus.cc:383] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.538719 23206 raft_consensus.cc:738] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.539470 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27c19622df5416eb965291aeb863154" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:59.540397 23203 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.540853 23203 ts_tablet_manager.cc:1397] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.016s user 0.005s sys 0.003s
I20250109 21:10:59.540970 23051 leader_election.cc:304] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:59.541416 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c762018d1be74ce190b41ebd28a2e93e" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:10:59.543205 23206 consensus_queue.cc:260] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.543620 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e27c19622df5416eb965291aeb863154" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.543360 23203 raft_consensus.cc:357] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.544198 23203 raft_consensus.cc:383] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.544482 23203 raft_consensus.cc:738] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.545010 22976 leader_election.cc:304] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:59.545451 23206 ts_tablet_manager.cc:1428] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.011s user 0.002s sys 0.003s
I20250109 21:10:59.545078 23203 consensus_queue.cc:260] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.546240 23382 raft_consensus.cc:2743] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:59.546712 23206 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:59.547868 23203 ts_tablet_manager.cc:1428] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20250109 21:10:59.548806 23203 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.550216 23497 raft_consensus.cc:2798] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:59.550680 23497 raft_consensus.cc:491] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:59.553431 23206 tablet_bootstrap.cc:654] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.554384 23203 tablet_bootstrap.cc:654] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.559823 23385 consensus_queue.cc:1035] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
W20250109 21:10:59.562057 23049 leader_election.cc:343] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.564368 23202 tablet_bootstrap.cc:492] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:59.569749 23203 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.570302 23203 ts_tablet_manager.cc:1397] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.022s user 0.012s sys 0.002s
I20250109 21:10:59.551021 23497 raft_consensus.cc:3054] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.574688 23203 raft_consensus.cc:357] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.583473 23203 raft_consensus.cc:383] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.583760 23203 raft_consensus.cc:738] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.584416 23203 consensus_queue.cc:260] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.585171 23268 raft_consensus.cc:491] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.585678 23268 raft_consensus.cc:513] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.586565 23382 raft_consensus.cc:491] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.586797 23203 ts_tablet_manager.cc:1428] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20250109 21:10:59.587085 23382 raft_consensus.cc:513] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.587692 23268 leader_election.cc:290] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:59.587848 23203 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.589104 23382 leader_election.cc:290] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:59.589650 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:59.587162 23420 consensus_queue.cc:1035] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250109 21:10:59.591012 23126 leader_election.cc:343] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.591581 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.594159 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:10:59.595654 22975 leader_election.cc:343] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.596029 23405 raft_consensus.cc:2743] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:10:59.597290 22976 leader_election.cc:343] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.597805 22976 leader_election.cc:304] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:59.599228 23382 raft_consensus.cc:2743] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:59.603643 23203 tablet_bootstrap.cc:654] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:59.606894 23049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 44909.2us
I20250109 21:10:59.611007 23268 raft_consensus.cc:491] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.611500 23268 raft_consensus.cc:513] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.612458 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.613101 23085 raft_consensus.cc:2463] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:59.613531 23268 leader_election.cc:290] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:10:59.614284 23049 consensus_peers.cc:487] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:10:59.615600 23125 leader_election.cc:304] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:59.617024 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e82f7c977e4539b1368607513bc151" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:59.618420 23124 leader_election.cc:343] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.619663 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e82f7c977e4539b1368607513bc151" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:59.620344 22933 raft_consensus.cc:2463] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:59.621726 23126 leader_election.cc:304] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:59.622821 23434 raft_consensus.cc:2798] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:59.623220 23434 raft_consensus.cc:491] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:59.623551 23434 raft_consensus.cc:3054] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.625102 23202 tablet_bootstrap.cc:654] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.628787 23203 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.629256 23203 ts_tablet_manager.cc:1397] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.042s user 0.011s sys 0.004s
I20250109 21:10:59.631207 23268 raft_consensus.cc:2798] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:59.631666 23268 raft_consensus.cc:491] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:59.631753 23203 raft_consensus.cc:357] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.635057 23389 raft_consensus.cc:491] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.635882 23203 raft_consensus.cc:383] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.635923 23268 raft_consensus.cc:3054] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.636312 23203 raft_consensus.cc:738] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.636065 23389 raft_consensus.cc:513] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.637061 23203 consensus_queue.cc:260] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.639353 23203 ts_tablet_manager.cc:1428] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.010s user 0.008s sys 0.000s
I20250109 21:10:59.639267 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b099b1062f574cac8c7d6ea4b425d639" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.640344 23389 leader_election.cc:290] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:59.641808 23457 raft_consensus.cc:491] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:59.642306 22901 leader_election.cc:343] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.642242 23457 raft_consensus.cc:513] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.644290 23457 leader_election.cc:290] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:59.640365 23203 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.647161 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:59.649060 22899 leader_election.cc:343] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.630520 23434 raft_consensus.cc:513] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.656603 23203 tablet_bootstrap.cc:654] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.657286 23434 leader_election.cc:290] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:59.658285 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:59.653540 23382 raft_consensus.cc:491] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.660506 23204 ts_tablet_manager.cc:1428] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.199s user 0.008s sys 0.000s
I20250109 21:10:59.660388 23382 raft_consensus.cc:513] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.661255 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
W20250109 21:10:59.661775 23126 leader_election.cc:343] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.661950 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.662521 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b099b1062f574cac8c7d6ea4b425d639" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.659255 23268 raft_consensus.cc:513] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:10:59.667531 22900 leader_election.cc:343] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.668136 22900 leader_election.cc:304] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:59.669102 23389 raft_consensus.cc:491] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.669560 23389 raft_consensus.cc:513] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.661877 23085 raft_consensus.cc:3054] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.674319 23204 tablet_bootstrap.cc:492] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:10:59.678826 23389 leader_election.cc:290] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:10:59.671775 23457 raft_consensus.cc:491] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.680065 23457 raft_consensus.cc:513] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.680434 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:59.681859 22899 leader_election.cc:343] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.682096 23457 leader_election.cc:290] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:59.683423 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4309ed0e1fa847329590a19703399802" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.673027 23307 raft_consensus.cc:2743] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:59.685611 23384 raft_consensus.cc:491] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:10:59.686125 22900 leader_election.cc:343] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.686084 23384 raft_consensus.cc:513] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.686653 22900 leader_election.cc:304] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:10:59.698385 23268 leader_election.cc:290] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:59.695219 23307 raft_consensus.cc:491] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.699501 23307 raft_consensus.cc:513] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.700093 23457 raft_consensus.cc:2743] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:59.701418 23307 leader_election.cc:290] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:59.701567 23384 leader_election.cc:290] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:59.702987 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:10:59.704396 23051 leader_election.cc:343] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.707798 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:10:59.717993 22899 leader_election.cc:343] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.723331 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e82f7c977e4539b1368607513bc151" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:59.724009 22930 raft_consensus.cc:3054] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.727792 23382 leader_election.cc:290] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
W20250109 21:10:59.729339 22901 leader_election.cc:343] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.729254 23279 consensus_queue.cc:1035] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:59.730901 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f32bf225644269afca55cb6491e09a" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.731580 23083 raft_consensus.cc:2463] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:10:59.733150 22975 leader_election.cc:304] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:59.735555 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:59.736222 22933 raft_consensus.cc:2463] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:10:59.739508 23382 raft_consensus.cc:2798] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:59.739928 23382 raft_consensus.cc:491] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:59.740252 23382 raft_consensus.cc:3054] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.742614 23006 raft_consensus.cc:3054] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.739522 23051 leader_election.cc:304] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:10:59.744346 23384 raft_consensus.cc:2798] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:59.744693 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.744700 23384 raft_consensus.cc:491] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:59.745697 23384 raft_consensus.cc:3054] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.742480 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e82f7c977e4539b1368607513bc151" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:10:59.749126 23382 raft_consensus.cc:513] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.751199 23382 leader_election.cc:290] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
W20250109 21:10:59.751278 23124 leader_election.cc:343] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.753326 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f32bf225644269afca55cb6491e09a" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:59.754103 23157 raft_consensus.cc:3054] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.759413 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f32bf225644269afca55cb6491e09a" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.762106 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f32bf225644269afca55cb6491e09a" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:10:59.762828 23083 raft_consensus.cc:3054] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.769482 22930 raft_consensus.cc:2463] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:59.772426 23126 leader_election.cc:304] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:59.793849 23268 raft_consensus.cc:2798] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
W20250109 21:10:59.793942 22901 leader_election.cc:343] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.794399 23268 raft_consensus.cc:695] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:59.794484 22901 leader_election.cc:304] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:10:59.795306 23307 raft_consensus.cc:2743] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:10:59.795306 23268 consensus_queue.cc:237] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:10:59.797349 23202 tablet_bootstrap.cc:492] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:10:59.797856 23202 ts_tablet_manager.cc:1397] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.234s user 0.021s sys 0.001s
I20250109 21:10:59.799809 23203 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:10:59.800207 23203 ts_tablet_manager.cc:1397] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.160s user 0.010s sys 0.016s
I20250109 21:10:59.804244 23083 raft_consensus.cc:2463] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:59.805797 23203 raft_consensus.cc:357] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.806519 23203 raft_consensus.cc:383] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.806819 23203 raft_consensus.cc:738] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.807543 23203 consensus_queue.cc:260] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.795250 23384 raft_consensus.cc:513] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.812680 23085 raft_consensus.cc:2463] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:10:59.816008 22830 catalog_manager.cc:5526] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.819849 23202 raft_consensus.cc:357] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.820556 23202 raft_consensus.cc:383] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.820814 23202 raft_consensus.cc:738] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.823309 23202 consensus_queue.cc:260] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.826792 22975 leader_election.cc:304] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:59.829429 23405 raft_consensus.cc:2798] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:59.829986 23405 raft_consensus.cc:695] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:10:59.830760 23125 leader_election.cc:304] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:10:59.830829 23405 consensus_queue.cc:237] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.827848 23202 ts_tablet_manager.cc:1428] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.030s user 0.007s sys 0.000s
I20250109 21:10:59.834982 23206 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:10:59.835603 23203 ts_tablet_manager.cc:1428] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.035s user 0.007s sys 0.000s
I20250109 21:10:59.836414 23206 ts_tablet_manager.cc:1397] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.290s user 0.053s sys 0.050s
I20250109 21:10:59.837004 23202 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:10:59.812076 23497 raft_consensus.cc:513] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.836251 23279 raft_consensus.cc:2798] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:59.848868 23206 raft_consensus.cc:357] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.849611 23206 raft_consensus.cc:383] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:10:59.849862 23206 raft_consensus.cc:738] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:10:59.854619 23497 leader_election.cc:290] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:10:59.855324 22931 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c762018d1be74ce190b41ebd28a2e93e" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:59.855963 22931 raft_consensus.cc:3054] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.855993 23279 raft_consensus.cc:695] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:10:59.859582 23203 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:10:59.858644 23206 consensus_queue.cc:260] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.862584 23384 leader_election.cc:290] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:59.843832 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.874465 23307 raft_consensus.cc:491] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.888653 23206 ts_tablet_manager.cc:1428] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.050s user 0.004s sys 0.003s
I20250109 21:10:59.890511 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:10:59.891222 22930 raft_consensus.cc:3054] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.893329 23204 tablet_bootstrap.cc:654] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.884531 23279 consensus_queue.cc:237] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.896462 23434 raft_consensus.cc:491] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.896947 23434 raft_consensus.cc:513] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.899399 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:10:59.900053 23152 raft_consensus.cc:3054] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:10:59.901397 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:10:59.902081 22933 raft_consensus.cc:2463] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:10:59.887873 23307 raft_consensus.cc:513] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.904731 23307 leader_election.cc:290] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:59.906267 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:10:59.907572 23203 tablet_bootstrap.cc:654] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
W20250109 21:10:59.907712 22901 leader_election.cc:343] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:10:59.912339 23126 leader_election.cc:304] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:10:59.912787 23434 leader_election.cc:290] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:10:59.913856 23434 raft_consensus.cc:2798] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:10:59.914208 23434 raft_consensus.cc:491] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:10:59.914544 22831 catalog_manager.cc:5526] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:10:59.914556 23434 raft_consensus.cc:3054] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:10:59.925522 23124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 62736.2us
I20250109 21:10:59.929075 23206 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:10:59.916378 22931 raft_consensus.cc:2463] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:59.941936 23202 tablet_bootstrap.cc:654] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:10:59.930794 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4309ed0e1fa847329590a19703399802" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.935312 23537 raft_consensus.cc:491] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.960541 23420 consensus_queue.cc:1035] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:10:59.962932 23051 leader_election.cc:304] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:10:59.963858 23542 raft_consensus.cc:2798] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:10:59.964378 23542 raft_consensus.cc:695] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:10:59.965160 23542 consensus_queue.cc:237] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:10:59.966987 23537 raft_consensus.cc:513] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:10:59.969147 23537 leader_election.cc:290] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:59.936501 23157 raft_consensus.cc:2463] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:10:59.977864 23544 consensus_queue.cc:1035] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:10:59.979282 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:10:59.972769 23457 raft_consensus.cc:491] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.982215 23457 raft_consensus.cc:513] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.983520 23152 raft_consensus.cc:2463] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:59.984197 23457 leader_election.cc:290] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:10:59.986014 22930 raft_consensus.cc:2463] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:10:59.988340 23307 raft_consensus.cc:491] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:10:59.988823 23307 raft_consensus.cc:513] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:10:59.990792 23307 leader_election.cc:290] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
W20250109 21:10:59.996697 23126 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 83169.8us
I20250109 21:11:00.000620 23051 leader_election.cc:304] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
W20250109 21:11:00.018265 23541 log.cc:926] Time spent T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c: Append to log took a long time: real 0.065s user 0.000s sys 0.000s
I20250109 21:11:00.019476 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.023381 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.024418 23082 raft_consensus.cc:2388] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51679b9f547940b6a8311fd6fab340f7 in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:11:00.025060 23078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.026305 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.026419 23008 raft_consensus.cc:3054] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.013113 23385 raft_consensus.cc:2798] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:00.026435 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:00.034384 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c762018d1be74ce190b41ebd28a2e93e" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
W20250109 21:11:00.032873 22900 leader_election.cc:343] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:00.035724 23125 leader_election.cc:343] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.059383 23204 tablet_bootstrap.cc:492] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:00.060109 23204 ts_tablet_manager.cc:1397] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.386s user 0.022s sys 0.014s
I20250109 21:11:00.040854 23385 raft_consensus.cc:695] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:00.092192 23385 consensus_queue.cc:237] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:11:00.103368 23049 leader_election.cc:343] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.102506 23204 raft_consensus.cc:357] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.107429 23204 raft_consensus.cc:383] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.107848 23204 raft_consensus.cc:738] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.108700 23204 consensus_queue.cc:260] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.110759 23206 tablet_bootstrap.cc:654] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
W20250109 21:11:00.097980 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:11:00.052129 22900 leader_election.cc:304] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
W20250109 21:11:00.078116 23125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 45868us
I20250109 21:11:00.116076 23204 ts_tablet_manager.cc:1428] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.056s user 0.008s sys 0.000s
I20250109 21:11:00.117805 23204 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:00.123273 23203 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:11:00.123696 23203 ts_tablet_manager.cc:1397] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.281s user 0.012s sys 0.020s
W20250109 21:11:00.114481 22901 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 137193us
I20250109 21:11:00.119681 23457 raft_consensus.cc:2743] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:11:00.126300 22900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 94548.1us
I20250109 21:11:00.126128 23434 raft_consensus.cc:513] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.140359 23389 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.151368 23389 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.153331 23389 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:00.145479 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:00.165661 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:00.155126 22976 leader_election.cc:304] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.176294 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:00.194327 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
W20250109 21:11:00.196391 23125 leader_election.cc:343] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.200199 23203 raft_consensus.cc:357] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.200770 23203 raft_consensus.cc:383] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.201005 23203 raft_consensus.cc:738] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.204382 23202 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:00.204815 23202 ts_tablet_manager.cc:1397] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.368s user 0.057s sys 0.042s
I20250109 21:11:00.202957 23203 consensus_queue.cc:260] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.212513 23203 ts_tablet_manager.cc:1428] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.089s user 0.007s sys 0.000s
W20250109 21:11:00.212694 22901 leader_election.cc:343] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:00.219372 22900 leader_election.cc:343] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.219861 22900 leader_election.cc:304] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
W20250109 21:11:00.221393 22901 leader_election.cc:343] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.212309 23434 leader_election.cc:290] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:00.223551 23203 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:00.226043 23561 raft_consensus.cc:2743] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:11:00.226408 22900 leader_election.cc:343] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.226888 22900 leader_election.cc:304] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.232131 23457 raft_consensus.cc:2743] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:00.236462 23384 raft_consensus.cc:491] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.237057 23384 raft_consensus.cc:513] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.240134 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:00.240763 23009 raft_consensus.cc:2463] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:00.240801 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:00.242188 23049 leader_election.cc:304] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
W20250109 21:11:00.242866 23051 leader_election.cc:343] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.243671 23385 raft_consensus.cc:2798] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:00.244053 23385 raft_consensus.cc:491] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:00.244367 23385 raft_consensus.cc:3054] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.261977 23203 tablet_bootstrap.cc:654] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.237584 23204 tablet_bootstrap.cc:654] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.242470 23384 leader_election.cc:290] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:00.269513 22829 catalog_manager.cc:5526] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:00.281116 23382 consensus_queue.cc:1035] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.005s
I20250109 21:11:00.290777 23202 raft_consensus.cc:357] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.291728 23202 raft_consensus.cc:383] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.292040 23202 raft_consensus.cc:738] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.292704 23202 consensus_queue.cc:260] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.293524 23206 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:00.294008 23206 ts_tablet_manager.cc:1397] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.367s user 0.008s sys 0.016s
I20250109 21:11:00.294804 23202 ts_tablet_manager.cc:1428] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.090s user 0.006s sys 0.000s
I20250109 21:11:00.295758 23202 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:00.296494 23206 raft_consensus.cc:357] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.297191 23206 raft_consensus.cc:383] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.297427 23405 raft_consensus.cc:2743] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:00.297456 23206 raft_consensus.cc:738] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.298511 23206 consensus_queue.cc:260] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.301635 23009 raft_consensus.cc:3054] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.302081 23206 ts_tablet_manager.cc:1428] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20250109 21:11:00.303074 23206 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:00.315342 23206 tablet_bootstrap.cc:654] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
W20250109 21:11:00.319028 22900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 90791us
I20250109 21:11:00.347919 23385 raft_consensus.cc:513] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.351019 23385 leader_election.cc:290] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:00.350904 22830 catalog_manager.cc:5526] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:00.351743 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:00.352360 23008 raft_consensus.cc:3054] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.355784 23202 tablet_bootstrap.cc:654] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.361732 23203 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:11:00.362180 23203 ts_tablet_manager.cc:1397] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.139s user 0.011s sys 0.006s
I20250109 21:11:00.364715 23203 raft_consensus.cc:357] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.365414 23203 raft_consensus.cc:383] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.365676 23203 raft_consensus.cc:738] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.366281 23203 consensus_queue.cc:260] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.370146 23434 consensus_queue.cc:1035] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:00.372977 22900 leader_election.cc:304] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.373747 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:00.378424 23008 raft_consensus.cc:2463] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
W20250109 21:11:00.382668 23051 leader_election.cc:343] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.383438 23049 leader_election.cc:304] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:11:00.383687 23457 raft_consensus.cc:3054] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.384377 23203 ts_tablet_manager.cc:1428] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.022s user 0.005s sys 0.002s
I20250109 21:11:00.389482 23384 raft_consensus.cc:2798] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:00.390206 23384 raft_consensus.cc:695] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:00.391346 23384 consensus_queue.cc:237] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.395385 23564 raft_consensus.cc:491] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.396050 23564 raft_consensus.cc:513] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.398383 23203 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:00.407593 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be8d475138234afd9334c27a5ef7b9ef" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:00.408064 23564 leader_election.cc:290] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:11:00.409369 22901 leader_election.cc:343] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:00.409600 22900 leader_election.cc:343] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.410075 22900 leader_election.cc:304] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.411370 23561 raft_consensus.cc:2743] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:00.414348 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be8d475138234afd9334c27a5ef7b9ef" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:11:00.416070 22899 leader_election.cc:343] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.416504 22899 leader_election.cc:304] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:00.417938 23382 consensus_queue.cc:1035] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:00.429774 23206 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:00.430245 23206 ts_tablet_manager.cc:1397] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.127s user 0.012s sys 0.000s
I20250109 21:11:00.431980 23203 tablet_bootstrap.cc:654] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.434650 23204 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:00.435298 23204 ts_tablet_manager.cc:1397] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.318s user 0.052s sys 0.043s
I20250109 21:11:00.436902 23544 consensus_queue.cc:1035] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:00.438086 23202 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:00.456274 23202 ts_tablet_manager.cc:1397] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.161s user 0.005s sys 0.007s
I20250109 21:11:00.457120 23206 raft_consensus.cc:357] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.458530 23206 raft_consensus.cc:383] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.458851 23206 raft_consensus.cc:738] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.459618 23206 consensus_queue.cc:260] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.437989 23204 raft_consensus.cc:357] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.462203 23206 ts_tablet_manager.cc:1428] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.032s user 0.003s sys 0.004s
I20250109 21:11:00.462495 23204 raft_consensus.cc:383] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.439911 23457 raft_consensus.cc:2743] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:00.462857 23204 raft_consensus.cc:738] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.441689 23564 raft_consensus.cc:2743] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:00.446381 23203 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:11:00.447494 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.463675 23206 tablet_bootstrap.cc:492] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:00.464264 23203 ts_tablet_manager.cc:1397] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.066s user 0.015s sys 0.000s
I20250109 21:11:00.463639 23204 consensus_queue.cc:260] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.466408 23204 ts_tablet_manager.cc:1428] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.031s user 0.005s sys 0.001s
I20250109 21:11:00.466786 23203 raft_consensus.cc:357] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.467520 23203 raft_consensus.cc:383] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.467769 23203 raft_consensus.cc:738] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.471876 23203 consensus_queue.cc:260] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.474619 23206 tablet_bootstrap.cc:654] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.476698 23203 ts_tablet_manager.cc:1428] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20250109 21:11:00.481098 23152 raft_consensus.cc:3054] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.485886 23206 tablet_bootstrap.cc:492] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:00.486856 23206 ts_tablet_manager.cc:1397] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.023s user 0.009s sys 0.008s
I20250109 21:11:00.489353 23206 raft_consensus.cc:357] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.490111 23206 raft_consensus.cc:383] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.490486 23206 raft_consensus.cc:738] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.458776 23202 raft_consensus.cc:357] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.491083 23206 consensus_queue.cc:260] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.491554 23202 raft_consensus.cc:383] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.491885 23202 raft_consensus.cc:738] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.492987 23206 ts_tablet_manager.cc:1428] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:11:00.493955 23206 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:00.492136 22830 catalog_manager.cc:5526] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:00.496762 22830 catalog_manager.cc:5526] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:00.498322 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:00.498999 22930 raft_consensus.cc:3054] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.502324 23204 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:00.503912 23385 consensus_queue.cc:1035] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:00.507891 23206 tablet_bootstrap.cc:654] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.533058 23384 consensus_queue.cc:1035] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:00.541373 22930 raft_consensus.cc:2463] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:00.543809 23203 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:00.583498 23204 tablet_bootstrap.cc:654] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
W20250109 21:11:00.589056 23049 consensus_peers.cc:487] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: BOOTSTRAPPING. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:00.492506 23202 consensus_queue.cc:260] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.592712 23544 consensus_queue.cc:1035] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:00.606648 23497 consensus_queue.cc:1035] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:00.612962 23544 consensus_queue.cc:1035] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:00.615342 23204 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:00.615859 23204 ts_tablet_manager.cc:1397] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.114s user 0.009s sys 0.001s
I20250109 21:11:00.618103 23126 leader_election.cc:304] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.618949 23544 raft_consensus.cc:2798] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:00.618654 23204 raft_consensus.cc:357] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.619444 23204 raft_consensus.cc:383] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.619725 23204 raft_consensus.cc:738] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.620093 23544 raft_consensus.cc:695] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:00.620347 23204 consensus_queue.cc:260] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.621343 23544 consensus_queue.cc:237] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.622573 23204 ts_tablet_manager.cc:1428] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.006s user 0.003s sys 0.001s
I20250109 21:11:00.623557 23204 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:00.629631 23204 tablet_bootstrap.cc:654] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.632485 23202 ts_tablet_manager.cc:1428] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.176s user 0.006s sys 0.000s
I20250109 21:11:00.635067 23202 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:00.640352 23279 raft_consensus.cc:491] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.640902 23279 raft_consensus.cc:513] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.643672 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4309ed0e1fa847329590a19703399802" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.642901 23204 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:00.644359 23081 raft_consensus.cc:2463] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:11:00.645028 23204 ts_tablet_manager.cc:1397] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.022s user 0.003s sys 0.013s
I20250109 21:11:00.645834 23279 leader_election.cc:290] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:00.645778 23125 leader_election.cc:304] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:00.644340 23206 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:00.646802 23206 ts_tablet_manager.cc:1397] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.153s user 0.043s sys 0.058s
I20250109 21:11:00.646988 23279 raft_consensus.cc:2798] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:00.647362 23279 raft_consensus.cc:491] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:00.647701 23279 raft_consensus.cc:3054] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.647698 23204 raft_consensus.cc:357] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.648511 23204 raft_consensus.cc:383] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.648797 23204 raft_consensus.cc:738] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.649248 23206 raft_consensus.cc:357] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.649483 23204 consensus_queue.cc:260] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.650002 23206 raft_consensus.cc:383] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.650322 23206 raft_consensus.cc:738] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.651079 23206 consensus_queue.cc:260] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.650512 22832 catalog_manager.cc:5526] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:00.655329 23204 ts_tablet_manager.cc:1428] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250109 21:11:00.656303 23204 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:00.653542 23206 ts_tablet_manager.cc:1428] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:11:00.658393 23206 tablet_bootstrap.cc:492] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:00.662310 23204 tablet_bootstrap.cc:654] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.662653 23206 tablet_bootstrap.cc:654] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
W20250109 21:11:00.667224 22900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 49443.7us
W20250109 21:11:00.668181 22900 leader_election.cc:343] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.668605 22900 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.669787 23564 raft_consensus.cc:2743] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:00.677381 23279 raft_consensus.cc:513] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.680249 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4309ed0e1fa847329590a19703399802" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:00.681077 23081 raft_consensus.cc:3054] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.691696 23279 leader_election.cc:290] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:00.694559 23204 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:00.695115 23204 ts_tablet_manager.cc:1397] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.039s user 0.013s sys 0.006s
I20250109 21:11:00.698383 23203 tablet_bootstrap.cc:654] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.699219 23204 raft_consensus.cc:357] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.699998 23204 raft_consensus.cc:383] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.700300 23204 raft_consensus.cc:738] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.700903 23204 consensus_queue.cc:260] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.704888 23202 tablet_bootstrap.cc:654] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.737354 23204 ts_tablet_manager.cc:1428] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.040s user 0.005s sys 0.000s
I20250109 21:11:00.740342 23206 tablet_bootstrap.cc:492] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:00.740873 23206 ts_tablet_manager.cc:1397] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.083s user 0.034s sys 0.022s
I20250109 21:11:00.741370 23204 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:00.747104 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4309ed0e1fa847329590a19703399802" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:00.747288 23206 raft_consensus.cc:357] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.747897 22933 raft_consensus.cc:2463] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:11:00.748026 23206 raft_consensus.cc:383] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.749601 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4309ed0e1fa847329590a19703399802" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:00.749631 23206 raft_consensus.cc:738] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.750283 22933 raft_consensus.cc:3054] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.750586 23206 consensus_queue.cc:260] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.718530 23081 raft_consensus.cc:2463] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:00.752641 23125 leader_election.cc:304] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:00.754928 23434 raft_consensus.cc:2798] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:00.755434 23434 raft_consensus.cc:695] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:00.756369 23206 ts_tablet_manager.cc:1428] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.015s user 0.007s sys 0.000s
I20250109 21:11:00.756232 23434 consensus_queue.cc:237] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.757829 23206 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:00.753755 23204 tablet_bootstrap.cc:654] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.766527 23206 tablet_bootstrap.cc:654] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.768335 22933 raft_consensus.cc:2463] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:00.777922 23206 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:00.777685 23385 consensus_queue.cc:1035] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:00.779178 23206 ts_tablet_manager.cc:1397] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.010s
I20250109 21:11:00.781770 23206 raft_consensus.cc:357] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.783152 23206 raft_consensus.cc:383] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.783495 23206 raft_consensus.cc:738] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.784538 23203 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: No bootstrap required, opened a new log
I20250109 21:11:00.785017 23203 ts_tablet_manager.cc:1397] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.241s user 0.009s sys 0.001s
I20250109 21:11:00.785519 23206 consensus_queue.cc:260] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.787744 23206 ts_tablet_manager.cc:1428] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.008s user 0.005s sys 0.001s
I20250109 21:11:00.788687 23206 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:00.790462 23564 raft_consensus.cc:491] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.790977 23564 raft_consensus.cc:513] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.810720 23206 tablet_bootstrap.cc:654] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.811570 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a6a46398de4d2f994691863b60ded9" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:11:00.814282 22899 leader_election.cc:343] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.815770 23564 leader_election.cc:290] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:00.817112 23202 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:00.817620 23202 ts_tablet_manager.cc:1397] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.183s user 0.009s sys 0.001s
I20250109 21:11:00.817438 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a6a46398de4d2f994691863b60ded9" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.819882 23405 raft_consensus.cc:491] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.820755 23279 raft_consensus.cc:491] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.820564 23405 raft_consensus.cc:513] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.821619 23204 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:00.821240 23279 raft_consensus.cc:513] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.823227 23279 leader_election.cc:290] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:00.824622 23203 raft_consensus.cc:357] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.825390 23203 raft_consensus.cc:383] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.825716 23203 raft_consensus.cc:738] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.825765 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:00.826583 23204 ts_tablet_manager.cc:1397] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.085s user 0.014s sys 0.001s
I20250109 21:11:00.826725 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.830799 23157 raft_consensus.cc:3054] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.830848 23405 leader_election.cc:290] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:00.832243 23202 raft_consensus.cc:357] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.832955 23202 raft_consensus.cc:383] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.833196 23202 raft_consensus.cc:738] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.833768 23202 consensus_queue.cc:260] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.835448 23124 leader_election.cc:304] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.836997 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c762018d1be74ce190b41ebd28a2e93e" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:00.841014 23203 consensus_queue.cc:260] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.830863 23204 raft_consensus.cc:357] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.844331 23204 raft_consensus.cc:383] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:00.844590 23204 raft_consensus.cc:738] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:00.847455 23204 consensus_queue.cc:260] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.848970 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c762018d1be74ce190b41ebd28a2e93e" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:00.852037 23202 ts_tablet_manager.cc:1428] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.034s user 0.007s sys 0.000s
I20250109 21:11:00.853056 23202 tablet_bootstrap.cc:492] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:00.861536 23204 ts_tablet_manager.cc:1428] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.035s user 0.005s sys 0.000s
I20250109 21:11:00.862509 23204 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:00.864064 23385 raft_consensus.cc:491] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.865069 22976 leader_election.cc:304] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.864749 23385 raft_consensus.cc:513] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.867638 23385 leader_election.cc:290] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:00.868826 23405 raft_consensus.cc:2743] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:00.870194 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:11:00.872437 23049 leader_election.cc:343] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.874302 23279 raft_consensus.cc:2743] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
W20250109 21:11:00.876786 22900 leader_election.cc:343] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.877446 22900 leader_election.cc:304] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:00.878417 23497 consensus_queue.cc:1035] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:00.882999 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:00.883880 22930 raft_consensus.cc:2463] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:00.885596 23051 leader_election.cc:304] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:00.888243 23497 raft_consensus.cc:2798] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:00.888772 23497 raft_consensus.cc:491] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:00.889282 23497 raft_consensus.cc:3054] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.894708 23385 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.895296 23385 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:00.847550 22830 catalog_manager.cc:5526] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:00.898085 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:00.900014 23202 tablet_bootstrap.cc:654] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:00.911034 23385 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:00.890774 23204 tablet_bootstrap.cc:654] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
W20250109 21:11:00.913157 23051 leader_election.cc:343] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.919391 23537 raft_consensus.cc:491] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.919900 23537 raft_consensus.cc:513] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.920423 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:00.921144 22930 raft_consensus.cc:2463] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:00.921973 23537 leader_election.cc:290] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:00.908003 23564 raft_consensus.cc:2743] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:00.924340 23051 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:11:00.924492 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be8d475138234afd9334c27a5ef7b9ef" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:00.925580 23384 raft_consensus.cc:2798] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:00.927022 23384 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:00.927372 23384 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:11:00.935622 22900 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 58882.1us
I20250109 21:11:00.940042 23457 raft_consensus.cc:491] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.940572 23457 raft_consensus.cc:513] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.945358 23457 leader_election.cc:290] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:00.947116 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd29e1c05b4a4a5092fada7c6d4e2b21" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:00.949949 23546 raft_consensus.cc:491] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.950546 23546 raft_consensus.cc:513] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:00.952445 23546 leader_election.cc:290] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:00.953294 23497 raft_consensus.cc:513] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.955485 23497 leader_election.cc:290] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:11:00.964841 22899 leader_election.cc:343] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:00.965302 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:00.974556 22930 raft_consensus.cc:3054] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.925223 22933 raft_consensus.cc:2463] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:11:00.977893 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbd7a89d4ce745659bb16e1e800506ba" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:00.965891 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be8d475138234afd9334c27a5ef7b9ef" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:00.968981 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:00.982723 23279 raft_consensus.cc:491] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:00.982638 22930 raft_consensus.cc:2463] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:00.983506 23279 raft_consensus.cc:513] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:00.983942 22976 leader_election.cc:304] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:00.984360 23051 leader_election.cc:304] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:00.982721 23203 ts_tablet_manager.cc:1428] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.197s user 0.011s sys 0.014s
I20250109 21:11:00.985898 23279 leader_election.cc:290] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:00.986070 23537 raft_consensus.cc:2798] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:00.986510 23537 raft_consensus.cc:491] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:00.986737 23542 raft_consensus.cc:2798] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:00.986833 23537 raft_consensus.cc:3054] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:00.987325 23542 raft_consensus.cc:695] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:00.988170 23542 consensus_queue.cc:237] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:00.988916 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:11:00.983191 23124 leader_election.cc:343] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:01.006376 22976 leader_election.cc:343] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.008927 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:01.009357 23204 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:01.009936 23204 ts_tablet_manager.cc:1397] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.148s user 0.007s sys 0.013s
I20250109 21:11:00.985890 23384 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:11:01.010696 23124 leader_election.cc:343] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.012784 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbd7a89d4ce745659bb16e1e800506ba" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.013506 22930 raft_consensus.cc:2463] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:11:01.012760 23204 raft_consensus.cc:357] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.015645 23204 raft_consensus.cc:383] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.015919 23204 raft_consensus.cc:738] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.016464 23204 consensus_queue.cc:260] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.017036 23202 tablet_bootstrap.cc:492] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:01.017688 23202 ts_tablet_manager.cc:1397] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.165s user 0.014s sys 0.004s
I20250109 21:11:01.018684 23206 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:01.019147 23206 ts_tablet_manager.cc:1397] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.231s user 0.056s sys 0.068s
I20250109 21:11:01.022078 23206 raft_consensus.cc:357] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.022811 23206 raft_consensus.cc:383] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.023270 23206 raft_consensus.cc:738] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.023697 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:01.023875 23206 consensus_queue.cc:260] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.025264 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:01.025882 22934 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.026257 23204 ts_tablet_manager.cc:1428] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.016s user 0.003s sys 0.002s
I20250109 21:11:01.026337 23206 ts_tablet_manager.cc:1428] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
W20250109 21:11:01.026572 23051 leader_election.cc:343] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.030354 23204 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:01.031700 23206 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:01.028843 23537 raft_consensus.cc:513] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.037894 23126 leader_election.cc:304] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:01.038393 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be8d475138234afd9334c27a5ef7b9ef" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:01.038736 23279 raft_consensus.cc:2798] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:01.039233 23279 raft_consensus.cc:491] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:01.039570 23279 raft_consensus.cc:3054] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:11:01.039780 22976 leader_election.cc:343] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.042160 23537 leader_election.cc:290] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:01.042752 23206 tablet_bootstrap.cc:654] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.022593 23384 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
W20250109 21:11:01.043619 23049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 55278.8us
W20250109 21:11:01.044202 23049 leader_election.cc:343] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.043104 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be8d475138234afd9334c27a5ef7b9ef" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:01.046830 22930 raft_consensus.cc:3054] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.047132 23083 raft_consensus.cc:3054] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:11:01.053139 23125 leader_election.cc:343] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.053679 23125 leader_election.cc:304] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:01.054559 23434 raft_consensus.cc:2743] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:01.053786 22930 raft_consensus.cc:2463] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:01.055558 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd29e1c05b4a4a5092fada7c6d4e2b21" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:01.055668 22976 leader_election.cc:304] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:11:01.057022 23537 raft_consensus.cc:2798] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.058266 23537 raft_consensus.cc:695] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:01.059238 23537 consensus_queue.cc:237] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.068861 23279 raft_consensus.cc:513] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.071180 23279 leader_election.cc:290] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:01.072150 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbd7a89d4ce745659bb16e1e800506ba" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:01.072368 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbd7a89d4ce745659bb16e1e800506ba" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:01.073004 22930 raft_consensus.cc:3054] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.076946 23204 tablet_bootstrap.cc:654] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.076156 22831 catalog_manager.cc:5526] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
W20250109 21:11:01.073757 23124 leader_election.cc:343] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:01.079861 22900 leader_election.cc:343] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.080354 22900 leader_election.cc:304] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:01.081480 23564 raft_consensus.cc:2743] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:01.081444 23279 consensus_queue.cc:1035] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:01.090736 23009 raft_consensus.cc:3054] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.090991 23202 raft_consensus.cc:357] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:01.091959 23202 raft_consensus.cc:383] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.092250 23202 raft_consensus.cc:738] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.093057 23202 consensus_queue.cc:260] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:01.098518 23202 ts_tablet_manager.cc:1428] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.080s user 0.005s sys 0.003s
I20250109 21:11:01.083467 22934 raft_consensus.cc:2463] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:01.107779 22930 raft_consensus.cc:2463] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:01.109041 23126 leader_election.cc:304] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:01.101572 23202 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:01.119792 23051 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:11:01.115170 23434 raft_consensus.cc:2798] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.134953 23552 raft_consensus.cc:491] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.139384 23434 raft_consensus.cc:695] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:01.139482 23552 raft_consensus.cc:513] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.140300 23434 consensus_queue.cc:237] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.141105 23497 raft_consensus.cc:491] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.141525 23552 leader_election.cc:290] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:01.141619 23497 raft_consensus.cc:513] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.143746 23497 leader_election.cc:290] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:01.142930 22832 catalog_manager.cc:5526] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:01.148437 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:01.126483 23601 raft_consensus.cc:2798] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.151615 23601 raft_consensus.cc:695] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:01.152695 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:01.153378 23157 raft_consensus.cc:2463] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 0.
W20250109 21:11:01.154600 22899 leader_election.cc:343] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.157598 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.158378 22934 raft_consensus.cc:2463] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:01.160234 22901 leader_election.cc:304] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:01.160987 23546 consensus_queue.cc:1035] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:01.162245 23564 raft_consensus.cc:2798] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:01.162650 23564 raft_consensus.cc:491] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:01.162987 23564 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.162823 23051 leader_election.cc:304] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:01.163918 23384 raft_consensus.cc:2798] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:01.166528 23384 raft_consensus.cc:491] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:01.166888 23384 raft_consensus.cc:3054] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.153506 23601 consensus_queue.cc:237] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.170351 23204 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:01.170862 23204 ts_tablet_manager.cc:1397] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.141s user 0.010s sys 0.001s
I20250109 21:11:01.172855 23564 raft_consensus.cc:513] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.173607 23204 raft_consensus.cc:357] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.174332 23204 raft_consensus.cc:383] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.174608 23204 raft_consensus.cc:738] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.178287 23204 consensus_queue.cc:260] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.178709 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
W20250109 21:11:01.180166 22899 leader_election.cc:343] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.181028 23204 ts_tablet_manager.cc:1428] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250109 21:11:01.181387 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:01.181967 23157 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.181988 23204 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:01.198781 23202 tablet_bootstrap.cc:654] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.210041 23279 raft_consensus.cc:491] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.210580 23279 raft_consensus.cc:513] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.212534 23279 leader_election.cc:290] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:01.218329 23384 raft_consensus.cc:513] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.221172 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:01.221292 23384 leader_election.cc:290] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:01.221822 22933 raft_consensus.cc:3054] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.210584 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:01.225140 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b099b1062f574cac8c7d6ea4b425d639" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.225840 22934 raft_consensus.cc:2463] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:11:01.227964 23126 leader_election.cc:304] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:01.229282 23279 raft_consensus.cc:2798] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:01.229656 23279 raft_consensus.cc:491] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:01.229990 23279 raft_consensus.cc:3054] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.230100 23206 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:01.230638 23206 ts_tablet_manager.cc:1397] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.199s user 0.024s sys 0.038s
I20250109 21:11:01.233103 23206 raft_consensus.cc:357] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.233762 23206 raft_consensus.cc:383] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.234007 23206 raft_consensus.cc:738] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.192272 23564 leader_election.cc:290] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:01.236490 23157 raft_consensus.cc:2463] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 1.
I20250109 21:11:01.238168 22901 leader_election.cc:304] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:01.239437 23206 consensus_queue.cc:260] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.240335 23564 raft_consensus.cc:2798] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.242507 23564 raft_consensus.cc:695] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:01.244483 22831 catalog_manager.cc:5526] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:01.245288 23564 consensus_queue.cc:237] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.242516 23206 ts_tablet_manager.cc:1428] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.012s user 0.005s sys 0.001s
I20250109 21:11:01.247253 23206 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
W20250109 21:11:01.260051 23049 leader_election.cc:343] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.263221 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b099b1062f574cac8c7d6ea4b425d639" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:01.267208 23383 raft_consensus.cc:491] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.272384 22830 catalog_manager.cc:5526] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
W20250109 21:11:01.276733 23125 leader_election.cc:343] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.275624 23383 raft_consensus.cc:513] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:01.293866 23383 leader_election.cc:290] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:01.295471 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:01.296157 23157 raft_consensus.cc:2463] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:11:01.300626 23601 raft_consensus.cc:491] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.301301 23601 raft_consensus.cc:513] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.303475 23601 leader_election.cc:290] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:01.304180 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a6a46398de4d2f994691863b60ded9" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.304520 23206 tablet_bootstrap.cc:654] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.304879 22930 raft_consensus.cc:2463] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:01.306114 23051 leader_election.cc:304] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:01.306411 22933 raft_consensus.cc:2463] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:01.282246 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:01.308010 23051 leader_election.cc:304] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:01.308746 23202 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:01.308804 23610 raft_consensus.cc:2798] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.309322 23202 ts_tablet_manager.cc:1397] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.209s user 0.010s sys 0.006s
I20250109 21:11:01.309450 23610 raft_consensus.cc:695] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:01.310388 23610 consensus_queue.cc:237] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.312346 23202 raft_consensus.cc:357] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.313311 23279 raft_consensus.cc:513] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.315124 23202 raft_consensus.cc:383] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.306968 23601 raft_consensus.cc:2798] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:01.317883 23202 raft_consensus.cc:738] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.326264 22833 catalog_manager.cc:5526] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 0 to 1, leader changed from <none> to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:01.326949 23202 consensus_queue.cc:260] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.320405 22976 leader_election.cc:304] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:01.331336 23202 ts_tablet_manager.cc:1428] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.022s user 0.008s sys 0.000s
I20250109 21:11:01.329305 23601 raft_consensus.cc:491] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:01.336540 23206 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:01.339049 23609 consensus_queue.cc:1035] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:01.342403 23202 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:01.342581 23206 ts_tablet_manager.cc:1397] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.096s user 0.009s sys 0.003s
I20250109 21:11:01.342082 23601 raft_consensus.cc:3054] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.352691 23537 raft_consensus.cc:2798] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:01.358727 23537 raft_consensus.cc:491] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:01.359170 23537 raft_consensus.cc:3054] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.362936 23609 consensus_queue.cc:1035] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:01.365808 23279 leader_election.cc:290] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:01.368739 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b099b1062f574cac8c7d6ea4b425d639" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:01.369578 22930 raft_consensus.cc:3054] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.373144 23202 tablet_bootstrap.cc:654] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.375213 23204 tablet_bootstrap.cc:654] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.382551 23385 raft_consensus.cc:491] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.383396 23385 raft_consensus.cc:513] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.384953 22930 raft_consensus.cc:2463] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:01.385924 23385 leader_election.cc:290] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:01.386581 23126 leader_election.cc:304] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:01.388360 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.389096 22934 raft_consensus.cc:2463] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:01.390313 23051 leader_election.cc:304] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:01.391199 23546 raft_consensus.cc:2798] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.391388 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:01.391769 23546 raft_consensus.cc:695] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
W20250109 21:11:01.392853 23051 leader_election.cc:343] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.392779 23546 consensus_queue.cc:237] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.388370 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b099b1062f574cac8c7d6ea4b425d639" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:01.395680 23384 raft_consensus.cc:2798] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:01.396075 23384 raft_consensus.cc:491] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250109 21:11:01.396675 22975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 103619us
I20250109 21:11:01.393254 23537 raft_consensus.cc:513] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
W20250109 21:11:01.398564 23049 leader_election.cc:343] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.396416 23384 raft_consensus.cc:3054] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.402761 23601 raft_consensus.cc:513] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.409610 23206 raft_consensus.cc:357] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.410805 23206 raft_consensus.cc:383] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.411132 23206 raft_consensus.cc:738] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.408353 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:01.412503 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a6a46398de4d2f994691863b60ded9" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:11:01.415338 23049 leader_election.cc:343] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:01.418035 22975 leader_election.cc:343] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.420586 23601 leader_election.cc:290] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:11:01.402401 23125 leader_election.cc:343] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.425850 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a6a46398de4d2f994691863b60ded9" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:01.426767 22934 raft_consensus.cc:3054] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.429759 23206 consensus_queue.cc:260] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.437949 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a6a46398de4d2f994691863b60ded9" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
W20250109 21:11:01.438827 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:11:01.449513 23537 leader_election.cc:290] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
W20250109 21:11:01.450796 23049 leader_election.cc:343] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.451402 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
W20250109 21:11:01.451579 23049 consensus_peers.cc:487] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:01.451710 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
W20250109 21:11:01.458228 22975 leader_election.cc:343] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.452208 23159 raft_consensus.cc:3054] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.480414 23206 ts_tablet_manager.cc:1428] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.136s user 0.006s sys 0.001s
I20250109 21:11:01.452243 23384 raft_consensus.cc:513] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.493597 23206 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:01.501886 23202 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:01.502450 23202 ts_tablet_manager.cc:1397] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.169s user 0.013s sys 0.025s
I20250109 21:11:01.513264 23279 raft_consensus.cc:491] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.533846 23202 raft_consensus.cc:357] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.535039 23202 raft_consensus.cc:383] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.535310 23202 raft_consensus.cc:738] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.535815 23202 consensus_queue.cc:260] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.537746 23279 raft_consensus.cc:513] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.543852 23279 leader_election.cc:290] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:01.547464 23202 ts_tablet_manager.cc:1428] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.045s user 0.004s sys 0.004s
I20250109 21:11:01.544745 23621 consensus_queue.cc:1035] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.007s
I20250109 21:11:01.552052 23202 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
W20250109 21:11:01.552793 23624 log.cc:926] Time spent T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Append to log took a long time: real 0.075s user 0.002s sys 0.000s
I20250109 21:11:01.555359 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:01.558930 23159 raft_consensus.cc:2463] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:01.559868 23202 tablet_bootstrap.cc:654] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
W20250109 21:11:01.561481 23051 leader_election.cc:343] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:01.561837 22976 leader_election.cc:304] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:01.562033 23159 raft_consensus.cc:3054] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.563488 23405 raft_consensus.cc:2798] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.563977 23405 raft_consensus.cc:695] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:01.564868 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be8d475138234afd9334c27a5ef7b9ef" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.564814 23405 consensus_queue.cc:237] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:01.565639 22933 raft_consensus.cc:2388] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 1: Already voted for candidate df8c84b03e6f4a5288bdad949ba2447c in this term.
I20250109 21:11:01.569067 23006 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "be8d475138234afd9334c27a5ef7b9ef" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:01.570374 22830 catalog_manager.cc:5526] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:01.572005 23384 leader_election.cc:290] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:01.577287 23124 leader_election.cc:304] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:01.578924 23537 raft_consensus.cc:491] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.570488 22832 catalog_manager.cc:5526] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:01.590778 23537 raft_consensus.cc:513] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.592906 23537 leader_election.cc:290] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:01.587072 23206 tablet_bootstrap.cc:654] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.594046 23202 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:01.594559 23202 ts_tablet_manager.cc:1397] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.045s user 0.009s sys 0.009s
I20250109 21:11:01.578927 22934 raft_consensus.cc:2463] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:01.596400 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbd7a89d4ce745659bb16e1e800506ba" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:01.597263 23202 raft_consensus.cc:357] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.600134 23009 raft_consensus.cc:3054] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.600400 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:01.601260 22934 raft_consensus.cc:3054] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.597970 23202 raft_consensus.cc:383] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.607474 23202 raft_consensus.cc:738] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.609645 23204 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:01.610142 23204 ts_tablet_manager.cc:1397] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.428s user 0.014s sys 0.031s
I20250109 21:11:01.608145 23202 consensus_queue.cc:260] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.611243 23051 leader_election.cc:304] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:01.612396 23497 raft_consensus.cc:2798] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.612852 23497 raft_consensus.cc:695] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:01.613035 23279 consensus_queue.cc:1035] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:01.613699 23497 consensus_queue.cc:237] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.616587 23202 ts_tablet_manager.cc:1428] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.022s user 0.006s sys 0.001s
I20250109 21:11:01.616909 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbd7a89d4ce745659bb16e1e800506ba" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.617519 23202 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:01.617818 22930 raft_consensus.cc:2388] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:11:01.618520 23405 raft_consensus.cc:491] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.619064 23405 raft_consensus.cc:513] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.621381 23405 leader_election.cc:290] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:01.622690 23204 raft_consensus.cc:357] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.623107 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:01.624161 23152 raft_consensus.cc:2388] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate 51679b9f547940b6a8311fd6fab340f7 in this term.
I20250109 21:11:01.624934 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.624975 22831 catalog_manager.cc:5526] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:01.626984 23204 raft_consensus.cc:383] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.629138 23204 raft_consensus.cc:738] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.630105 23204 consensus_queue.cc:260] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.632081 23601 consensus_queue.cc:1035] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:01.633234 22976 leader_election.cc:304] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:01.640426 23405 raft_consensus.cc:2743] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:01.640560 23202 tablet_bootstrap.cc:654] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.647019 23204 ts_tablet_manager.cc:1428] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.037s user 0.008s sys 0.000s
I20250109 21:11:01.655654 23204 tablet_bootstrap.cc:492] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:01.659449 22934 raft_consensus.cc:2463] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:01.660986 23051 leader_election.cc:304] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:11:01.662113 23601 raft_consensus.cc:2798] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:01.662613 23601 raft_consensus.cc:695] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:01.663806 23601 consensus_queue.cc:237] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.670162 23204 tablet_bootstrap.cc:654] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.647843 23206 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:01.671991 23206 ts_tablet_manager.cc:1397] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.179s user 0.016s sys 0.002s
I20250109 21:11:01.673413 22831 catalog_manager.cc:5526] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:01.674455 23206 raft_consensus.cc:357] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.674850 23202 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:01.675207 23206 raft_consensus.cc:383] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.643666 22976 leader_election.cc:304] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:01.675454 23202 ts_tablet_manager.cc:1397] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.058s user 0.012s sys 0.002s
I20250109 21:11:01.675510 23206 raft_consensus.cc:738] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.676728 23537 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.676761 23544 consensus_queue.cc:1035] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:01.677495 23546 raft_consensus.cc:2743] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:01.688333 23206 consensus_queue.cc:260] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:01.696743 23619 consensus_queue.cc:1035] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:01.696861 23202 raft_consensus.cc:357] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.697548 23202 raft_consensus.cc:383] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.697821 23202 raft_consensus.cc:738] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.698061 23206 ts_tablet_manager.cc:1428] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20250109 21:11:01.700474 23206 tablet_bootstrap.cc:492] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:01.698426 23202 consensus_queue.cc:260] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.710988 23206 tablet_bootstrap.cc:654] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.713032 23006 raft_consensus.cc:3054] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.714011 23537 raft_consensus.cc:2743] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:01.725337 23202 ts_tablet_manager.cc:1428] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.049s user 0.004s sys 0.002s
I20250109 21:11:01.736830 23152 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.743782 23610 consensus_queue.cc:1035] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:01.748241 23202 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:01.811456 23204 tablet_bootstrap.cc:492] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:01.811950 23204 ts_tablet_manager.cc:1397] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.156s user 0.018s sys 0.001s
I20250109 21:11:01.810947 23564 consensus_queue.cc:1035] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.018s
I20250109 21:11:01.826707 23085 raft_consensus.cc:3054] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:01.838284 23204 raft_consensus.cc:357] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:01.840868 23204 raft_consensus.cc:383] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:01.841140 23204 raft_consensus.cc:738] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:01.841730 23204 consensus_queue.cc:260] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:01.853801 23497 consensus_queue.cc:1035] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:01.854624 23384 consensus_queue.cc:1035] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:01.833175 23621 raft_consensus.cc:491] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.870934 22830 catalog_manager.cc:5526] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:01.876937 23206 tablet_bootstrap.cc:492] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:01.877452 23206 ts_tablet_manager.cc:1397] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.177s user 0.021s sys 0.019s
I20250109 21:11:01.896677 23279 raft_consensus.cc:491] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.897199 23279 raft_consensus.cc:513] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.898993 23279 leader_election.cc:290] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:01.900346 23542 consensus_queue.cc:1035] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:01.903796 23546 consensus_queue.cc:1035] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:01.875142 23621 raft_consensus.cc:513] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:01.911348 23202 tablet_bootstrap.cc:654] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:01.935973 23641 raft_consensus.cc:491] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:01.937029 23641 raft_consensus.cc:513] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:01.952440 23204 ts_tablet_manager.cc:1428] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.140s user 0.040s sys 0.042s
I20250109 21:11:01.953650 23204 tablet_bootstrap.cc:492] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:01.943694 23621 leader_election.cc:290] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:01.975718 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:01.976425 22933 raft_consensus.cc:2463] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:11:02.019145 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:02.030707 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:02.039280 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:02.041639 23202 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:02.042145 23202 ts_tablet_manager.cc:1397] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.294s user 0.007s sys 0.010s
I20250109 21:11:02.043895 23126 leader_election.cc:304] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:02.045185 23279 raft_consensus.cc:2798] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:02.045544 23279 raft_consensus.cc:491] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:02.045907 23279 raft_consensus.cc:3054] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.050280 23641 leader_election.cc:290] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:02.051985 22976 leader_election.cc:304] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:02.054554 23206 raft_consensus.cc:357] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.055341 23206 raft_consensus.cc:383] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.055606 23206 raft_consensus.cc:738] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.057691 23206 consensus_queue.cc:260] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.059964 23206 ts_tablet_manager.cc:1428] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.182s user 0.007s sys 0.001s
I20250109 21:11:02.071231 23619 raft_consensus.cc:2743] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:02.079352 23155 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:02.085093 23457 consensus_queue.cc:1035] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
W20250109 21:11:02.090493 23124 leader_election.cc:343] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:02.093442 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:02.093837 23202 raft_consensus.cc:357] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:02.094694 23202 raft_consensus.cc:383] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.094985 23202 raft_consensus.cc:738] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
W20250109 21:11:02.096583 22899 leader_election.cc:343] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:02.097672 23279 raft_consensus.cc:513] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:02.103372 23202 consensus_queue.cc:260] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:02.105795 23083 raft_consensus.cc:3054] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.112185 23155 raft_consensus.cc:2388] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51679b9f547940b6a8311fd6fab340f7 in current term 1: Already voted for candidate 227e48f30ae84db6bff43cc2860219a3 in this term.
I20250109 21:11:02.118170 22901 leader_election.cc:304] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:02.078693 23206 tablet_bootstrap.cc:492] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:02.121989 23279 leader_election.cc:290] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:02.153053 23204 tablet_bootstrap.cc:654] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.167367 23405 consensus_queue.cc:1035] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:02.180083 23202 ts_tablet_manager.cc:1428] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.138s user 0.008s sys 0.000s
I20250109 21:11:02.121529 23552 raft_consensus.cc:3054] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.185722 23202 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:02.186591 23279 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:02.187031 23279 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.178767 23542 consensus_queue.cc:1035] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.009s
I20250109 21:11:02.192175 23279 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:02.193639 23653 raft_consensus.cc:491] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:02.203289 23653 raft_consensus.cc:513] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:02.205413 23653 leader_election.cc:290] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:02.206651 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:02.208222 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a6a46398de4d2f994691863b60ded9" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:02.208390 22934 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f4a6a46398de4d2f994691863b60ded9" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:02.209221 22934 raft_consensus.cc:2388] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 1: Already voted for candidate e1a492f3cf3a4827bb0045500a3abb83 in this term.
I20250109 21:11:02.210958 22975 leader_election.cc:304] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:02.213284 23621 raft_consensus.cc:3054] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:11:02.214531 23051 consensus_peers.cc:487] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Couldn't send request to peer 227e48f30ae84db6bff43cc2860219a3. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:02.180954 23537 consensus_queue.cc:1035] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.011s
I20250109 21:11:02.227603 22932 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:02.232870 23641 raft_consensus.cc:491] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:02.233583 23641 raft_consensus.cc:513] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:11:02.234660 23125 leader_election.cc:343] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:02.264190 23206 tablet_bootstrap.cc:654] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
W20250109 21:11:02.267618 23049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 44066.8us
I20250109 21:11:02.288106 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:02.288556 23610 consensus_queue.cc:1035] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:02.300124 23621 raft_consensus.cc:2743] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:02.348424 23552 raft_consensus.cc:2743] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:02.361735 23202 tablet_bootstrap.cc:654] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.361562 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:02.354694 23641 leader_election.cc:290] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:02.364037 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:11:02.408174 22900 leader_election.cc:343] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:02.421890 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 57440us
I20250109 21:11:02.423236 23279 consensus_queue.cc:1035] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:02.446305 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:11:02.453703 22901 leader_election.cc:343] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:02.454262 22901 leader_election.cc:304] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:02.420596 23662 consensus_queue.cc:1035] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.032s
W20250109 21:11:02.426544 23124 leader_election.cc:343] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:02.459914 23124 leader_election.cc:343] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:02.460332 23204 tablet_bootstrap.cc:492] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:02.460749 23204 ts_tablet_manager.cc:1397] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.507s user 0.011s sys 0.016s
I20250109 21:11:02.460451 23124 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:02.465498 23647 raft_consensus.cc:2743] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:02.491544 23204 raft_consensus.cc:357] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.492386 23204 raft_consensus.cc:383] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.492697 23204 raft_consensus.cc:738] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.493363 23204 consensus_queue.cc:260] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.491979 23206 tablet_bootstrap.cc:492] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:02.494597 23206 ts_tablet_manager.cc:1397] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.416s user 0.013s sys 0.022s
I20250109 21:11:02.494714 23202 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:02.495296 23202 ts_tablet_manager.cc:1397] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.310s user 0.009s sys 0.007s
I20250109 21:11:02.497681 23204 ts_tablet_manager.cc:1428] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.037s user 0.004s sys 0.004s
I20250109 21:11:02.498639 23204 tablet_bootstrap.cc:492] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:02.493530 23434 raft_consensus.cc:2743] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:02.506084 23204 tablet_bootstrap.cc:654] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.450639 22932 raft_consensus.cc:2463] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:02.532752 23126 leader_election.cc:304] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:02.533562 23434 raft_consensus.cc:2798] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:02.534044 23434 raft_consensus.cc:695] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:02.535092 23434 consensus_queue.cc:237] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:02.534044 23206 raft_consensus.cc:357] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.536967 23206 raft_consensus.cc:383] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.537246 23206 raft_consensus.cc:738] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.538473 23206 consensus_queue.cc:260] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.554471 23202 raft_consensus.cc:357] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:02.555383 23202 raft_consensus.cc:383] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.555666 23202 raft_consensus.cc:738] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.555845 23668 raft_consensus.cc:491] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:02.556480 23668 raft_consensus.cc:513] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:02.558902 22933 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:02.565110 23206 ts_tablet_manager.cc:1428] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.070s user 0.006s sys 0.000s
I20250109 21:11:02.566030 23206 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:02.573437 23202 consensus_queue.cc:260] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:11:02.574746 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 97749.7us
I20250109 21:11:02.583201 23206 tablet_bootstrap.cc:654] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.585999 23202 ts_tablet_manager.cc:1428] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.090s user 0.006s sys 0.000s
I20250109 21:11:02.587029 23202 tablet_bootstrap.cc:492] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
W20250109 21:11:02.591545 22881 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:11:02.594755 23202 tablet_bootstrap.cc:654] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.567341 23668 leader_election.cc:290] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:02.610878 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:02.644486 22975 leader_election.cc:304] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:02.649550 23009 raft_consensus.cc:3054] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.657670 22830 catalog_manager.cc:5526] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:02.695964 23202 tablet_bootstrap.cc:492] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:02.697338 23202 ts_tablet_manager.cc:1397] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.110s user 0.026s sys 0.041s
I20250109 21:11:02.700058 23202 raft_consensus.cc:357] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.700783 23202 raft_consensus.cc:383] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.701040 23202 raft_consensus.cc:738] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.704285 23668 raft_consensus.cc:491] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:02.704809 23668 raft_consensus.cc:513] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:02.709739 23668 leader_election.cc:290] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:02.709801 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd29e1c05b4a4a5092fada7c6d4e2b21" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:02.711438 23202 consensus_queue.cc:260] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.714084 23202 ts_tablet_manager.cc:1428] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.016s user 0.004s sys 0.002s
I20250109 21:11:02.714972 23202 tablet_bootstrap.cc:492] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
W20250109 21:11:02.716715 22975 leader_election.cc:343] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:02.722802 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd29e1c05b4a4a5092fada7c6d4e2b21" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:02.723474 22930 raft_consensus.cc:2463] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 0.
I20250109 21:11:02.724505 22976 leader_election.cc:304] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters: e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:02.725477 23405 raft_consensus.cc:2798] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:02.725838 23405 raft_consensus.cc:491] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:02.726164 23405 raft_consensus.cc:3054] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.730502 23206 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:02.731676 23206 ts_tablet_manager.cc:1397] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.166s user 0.021s sys 0.010s
I20250109 21:11:02.732302 23204 tablet_bootstrap.cc:492] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:02.732770 23204 ts_tablet_manager.cc:1397] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.234s user 0.012s sys 0.005s
I20250109 21:11:02.734061 23202 tablet_bootstrap.cc:654] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.734326 23206 raft_consensus.cc:357] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.735307 23206 raft_consensus.cc:383] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.735101 23204 raft_consensus.cc:357] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.735682 23206 raft_consensus.cc:738] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.735869 23204 raft_consensus.cc:383] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.737746 23204 raft_consensus.cc:738] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.738761 23653 raft_consensus.cc:2743] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:02.736454 23206 consensus_queue.cc:260] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.742235 23206 ts_tablet_manager.cc:1428] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.010s user 0.005s sys 0.000s
I20250109 21:11:02.743369 23206 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3: Bootstrap starting.
I20250109 21:11:02.749786 23206 tablet_bootstrap.cc:654] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.739658 23204 consensus_queue.cc:260] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.754977 23204 ts_tablet_manager.cc:1428] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.022s user 0.007s sys 0.001s
I20250109 21:11:02.756181 23204 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:02.762058 23405 raft_consensus.cc:513] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:02.776022 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd29e1c05b4a4a5092fada7c6d4e2b21" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:02.776623 22930 raft_consensus.cc:3054] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.787494 22930 raft_consensus.cc:2463] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:02.788429 22976 leader_election.cc:304] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:02.789216 23653 raft_consensus.cc:2798] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:02.790233 23653 raft_consensus.cc:695] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:02.791069 23653 consensus_queue.cc:237] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:02.797715 23405 leader_election.cc:290] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:02.797931 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd29e1c05b4a4a5092fada7c6d4e2b21" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
W20250109 21:11:02.799441 22975 leader_election.cc:343] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:02.816161 23204 tablet_bootstrap.cc:654] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.828735 22832 catalog_manager.cc:5526] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 0 to 1, leader changed from <none> to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 1 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:02.839077 23204 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:02.839690 23204 ts_tablet_manager.cc:1397] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.084s user 0.014s sys 0.008s
I20250109 21:11:02.836243 23202 tablet_bootstrap.cc:492] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:02.841570 23202 ts_tablet_manager.cc:1397] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.127s user 0.035s sys 0.035s
I20250109 21:11:02.845989 23202 raft_consensus.cc:357] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.847059 23202 raft_consensus.cc:383] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.847471 23202 raft_consensus.cc:738] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.848202 23202 consensus_queue.cc:260] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.838483 23206 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3: No bootstrap required, opened a new log
I20250109 21:11:02.849257 23206 ts_tablet_manager.cc:1397] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3: Time spent bootstrapping tablet: real 0.106s user 0.034s sys 0.039s
I20250109 21:11:02.851404 23204 raft_consensus.cc:357] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.852200 23204 raft_consensus.cc:383] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.854362 23202 ts_tablet_manager.cc:1428] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.012s user 0.001s sys 0.004s
I20250109 21:11:02.851758 23206 raft_consensus.cc:357] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.855253 23206 raft_consensus.cc:383] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.855526 23206 raft_consensus.cc:738] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.856084 23206 consensus_queue.cc:260] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.852516 23204 raft_consensus.cc:738] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.858158 23206 ts_tablet_manager.cc:1428] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3: Time spent starting tablet: real 0.009s user 0.003s sys 0.000s
I20250109 21:11:02.859864 23202 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c: Bootstrap starting.
I20250109 21:11:02.863493 23204 consensus_queue.cc:260] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.870242 23202 tablet_bootstrap.cc:654] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.878159 23204 ts_tablet_manager.cc:1428] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.038s user 0.006s sys 0.000s
I20250109 21:11:02.884073 23204 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83: Bootstrap starting.
I20250109 21:11:02.896955 23204 tablet_bootstrap.cc:654] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:02.898600 23676 raft_consensus.cc:491] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:02.899188 23676 raft_consensus.cc:513] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.901445 23676 leader_election.cc:290] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:02.904237 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:02.904942 23009 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:02.905988 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:02.907294 23152 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:02.909406 23049 leader_election.cc:304] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:02.910292 23644 raft_consensus.cc:2798] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:02.910681 23644 raft_consensus.cc:491] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:02.912271 23644 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.918438 23609 raft_consensus.cc:491] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:02.918998 23609 raft_consensus.cc:513] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.921093 23609 leader_election.cc:290] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:02.922891 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:02.923842 23081 raft_consensus.cc:2463] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:11:02.924857 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:02.925554 22930 raft_consensus.cc:2463] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 0.
I20250109 21:11:02.926676 23126 leader_election.cc:304] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:02.928565 23609 raft_consensus.cc:2798] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:02.928941 23609 raft_consensus.cc:491] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:02.929273 23609 raft_consensus.cc:3054] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.941040 23544 raft_consensus.cc:491] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:02.941560 23544 raft_consensus.cc:513] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.943897 23644 raft_consensus.cc:513] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.949558 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:02.950664 23544 leader_election.cc:290] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:02.955664 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:02.956938 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:02.957499 23009 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.959571 23126 leader_election.cc:304] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:02.965631 23546 raft_consensus.cc:2743] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:02.963883 23009 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:02.966573 23609 raft_consensus.cc:513] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:02.967389 23049 leader_election.cc:304] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:02.968298 23677 raft_consensus.cc:2798] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:02.968544 23609 leader_election.cc:290] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:02.968803 23677 raft_consensus.cc:695] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:02.969625 23677 consensus_queue.cc:237] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:02.970786 23202 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c: No bootstrap required, opened a new log
I20250109 21:11:02.971268 23202 ts_tablet_manager.cc:1397] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c: Time spent bootstrapping tablet: real 0.112s user 0.039s sys 0.035s
I20250109 21:11:02.971927 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:02.972491 22930 raft_consensus.cc:3054] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.974017 23644 leader_election.cc:290] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:02.975692 23202 raft_consensus.cc:357] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:02.976305 23202 raft_consensus.cc:383] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:02.976586 23202 raft_consensus.cc:738] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Initialized, Role: FOLLOWER
I20250109 21:11:02.976708 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:02.977380 23160 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:02.977226 23202 consensus_queue.cc:260] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:02.979399 23202 ts_tablet_manager.cc:1428] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:11:02.988173 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:02.989152 23081 raft_consensus.cc:3054] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:03.021725 23160 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:03.027474 23644 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:03.027978 23644 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:03.030117 23644 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:03.037060 23204 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83: No bootstrap required, opened a new log
I20250109 21:11:03.039026 23204 ts_tablet_manager.cc:1397] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83: Time spent bootstrapping tablet: real 0.155s user 0.031s sys 0.008s
I20250109 21:11:03.041411 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:03.042237 23010 raft_consensus.cc:2463] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:03.042390 23204 raft_consensus.cc:357] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:03.043228 23204 raft_consensus.cc:383] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:03.043502 23204 raft_consensus.cc:738] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Initialized, Role: FOLLOWER
I20250109 21:11:03.044122 23204 consensus_queue.cc:260] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:03.045171 23049 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:02.982695 22930 raft_consensus.cc:2463] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:03.045874 23644 raft_consensus.cc:2798] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:03.046319 23644 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:03.046651 23644 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:03.048151 23126 leader_election.cc:304] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:03.053735 23081 raft_consensus.cc:2463] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:03.056455 23644 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:03.057178 23609 raft_consensus.cc:2798] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:03.057708 23609 raft_consensus.cc:695] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:03.058557 23204 ts_tablet_manager.cc:1428] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83: Time spent starting tablet: real 0.019s user 0.006s sys 0.000s
I20250109 21:11:03.058521 23609 consensus_queue.cc:237] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:03.065263 22832 catalog_manager.cc:5526] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:03.041514 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:03.067899 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:03.068467 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:03.072396 23160 raft_consensus.cc:2463] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 0.
I20250109 21:11:03.073506 23010 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:03.068956 23644 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:03.090543 22833 catalog_manager.cc:5526] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 0 to 1, leader changed from <none> to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 1 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:03.094518 23010 raft_consensus.cc:2463] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:03.095700 23049 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:11:03.096416 23644 raft_consensus.cc:2798] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:03.096891 23644 raft_consensus.cc:695] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:03.097714 23644 consensus_queue.cc:237] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:03.108125 22833 catalog_manager.cc:5526] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 0 to 1, leader changed from <none> to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:03.109819 23644 raft_consensus.cc:491] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:03.111119 23644 raft_consensus.cc:513] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:03.113032 23644 leader_election.cc:290] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:03.116055 22930 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd29e1c05b4a4a5092fada7c6d4e2b21" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:03.116130 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fd29e1c05b4a4a5092fada7c6d4e2b21" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:03.116828 22930 raft_consensus.cc:2388] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate e1a492f3cf3a4827bb0045500a3abb83 in current term 1: Already voted for candidate df8c84b03e6f4a5288bdad949ba2447c in this term.
I20250109 21:11:03.118031 23051 leader_election.cc:304] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:03.118925 23644 raft_consensus.cc:3054] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:03.124269 23644 raft_consensus.cc:2743] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:03.137595 23544 consensus_queue.cc:1035] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.154006 23010 raft_consensus.cc:3054] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:03.166146 23546 consensus_queue.cc:1035] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.179463 23160 raft_consensus.cc:3054] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:03.211768 23405 consensus_queue.cc:1035] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.249702 23653 consensus_queue.cc:1035] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.415885 23676 consensus_queue.cc:1035] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.416749 23644 consensus_queue.cc:1035] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.559989 23609 consensus_queue.cc:1035] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.580709 23546 consensus_queue.cc:1035] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.684386 23644 consensus_queue.cc:1035] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.695807 23160 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:03.706506 23644 consensus_queue.cc:1035] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:03.929010 20003 tablet_server.cc:178] TabletServer@127.19.136.193:0 shutting down...
I20250109 21:11:03.975468 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:11:03.977182 20003 tablet_replica.cc:331] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:03.978209 20003 raft_consensus.cc:2238] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:03.979290 20003 raft_consensus.cc:2267] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:03.981510 20003 tablet_replica.cc:331] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:03.982339 20003 raft_consensus.cc:2238] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:03.982731 20003 raft_consensus.cc:2267] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:03.984858 20003 tablet_replica.cc:331] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:03.985422 20003 raft_consensus.cc:2238] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:03.985888 20003 raft_consensus.cc:2267] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:03.987188 23051 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 133 similar messages]
I20250109 21:11:03.987965 20003 tablet_replica.cc:331] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:03.988823 20003 raft_consensus.cc:2238] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:03.989264 20003 raft_consensus.cc:2267] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:03.991442 20003 tablet_replica.cc:331] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:03.992247 20003 raft_consensus.cc:2238] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:03.992709 20003 raft_consensus.cc:2267] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:03.994423 20003 tablet_replica.cc:331] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:03.995136 20003 raft_consensus.cc:2238] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:03.995519 20003 raft_consensus.cc:2267] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:03.998857 20003 tablet_replica.cc:331] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:03.999439 20003 raft_consensus.cc:2238] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:03.999857 20003 raft_consensus.cc:2267] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.001451 20003 tablet_replica.cc:331] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.002113 20003 raft_consensus.cc:2238] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.002538 20003 raft_consensus.cc:2267] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.004531 20003 tablet_replica.cc:331] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.005268 20003 raft_consensus.cc:2238] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.005677 20003 raft_consensus.cc:2267] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:04.005738 23051 consensus_peers.cc:487] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.007822 20003 tablet_replica.cc:331] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.008634 20003 raft_consensus.cc:2238] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.009052 20003 raft_consensus.cc:2267] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.011050 20003 tablet_replica.cc:331] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.011754 20003 raft_consensus.cc:2238] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.012176 20003 raft_consensus.cc:2267] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.014134 20003 tablet_replica.cc:331] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.014639 20003 raft_consensus.cc:2238] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.015000 20003 raft_consensus.cc:2267] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.016501 20003 tablet_replica.cc:331] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.017253 20003 raft_consensus.cc:2238] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.017699 20003 raft_consensus.cc:2267] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.020597 20003 tablet_replica.cc:331] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.021349 20003 raft_consensus.cc:2238] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.022133 20003 raft_consensus.cc:2267] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:04.022663 23126 consensus_peers.cc:487] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.024080 20003 tablet_replica.cc:331] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.025302 20003 raft_consensus.cc:2238] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.025746 20003 raft_consensus.cc:2267] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.028539 20003 tablet_replica.cc:331] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.029232 20003 raft_consensus.cc:2238] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.029680 20003 raft_consensus.cc:2267] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:04.031029 23051 consensus_peers.cc:487] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.031694 20003 tablet_replica.cc:331] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.032461 20003 raft_consensus.cc:2238] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.032824 20003 raft_consensus.cc:2267] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:04.032480 23126 consensus_peers.cc:487] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.034734 20003 tablet_replica.cc:331] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.035404 20003 raft_consensus.cc:2238] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.035825 20003 raft_consensus.cc:2267] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.037485 20003 tablet_replica.cc:331] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.038219 20003 raft_consensus.cc:2238] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.039144 20003 raft_consensus.cc:2267] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.041177 20003 tablet_replica.cc:331] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
W20250109 21:11:04.041426 23051 consensus_peers.cc:487] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.041887 20003 raft_consensus.cc:2238] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.042268 20003 raft_consensus.cc:2267] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.044107 20003 tablet_replica.cc:331] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.044694 20003 raft_consensus.cc:2238] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.045362 20003 raft_consensus.cc:2267] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.047351 20003 tablet_replica.cc:331] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
W20250109 21:11:04.047907 23126 consensus_peers.cc:487] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.047993 20003 raft_consensus.cc:2238] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.048602 20003 raft_consensus.cc:2267] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.050263 20003 tablet_replica.cc:331] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.050753 20003 raft_consensus.cc:2238] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.051476 20003 raft_consensus.cc:2267] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.052987 20003 tablet_replica.cc:331] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.053591 20003 raft_consensus.cc:2238] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.054018 20003 raft_consensus.cc:2267] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.055774 20003 tablet_replica.cc:331] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.056262 20003 raft_consensus.cc:2238] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.056599 20003 raft_consensus.cc:2267] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.058066 20003 tablet_replica.cc:331] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.058553 20003 raft_consensus.cc:2238] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.059360 20003 raft_consensus.cc:2267] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.061421 20003 tablet_replica.cc:331] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.062007 20003 raft_consensus.cc:2238] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.062888 20003 raft_consensus.cc:2267] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.064908 20003 tablet_replica.cc:331] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.065588 20003 raft_consensus.cc:2238] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.066018 20003 raft_consensus.cc:2267] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.067667 20003 tablet_replica.cc:331] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.068126 20003 raft_consensus.cc:2238] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.068445 20003 raft_consensus.cc:2267] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.070585 20003 tablet_replica.cc:331] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.071308 20003 raft_consensus.cc:2238] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.071724 20003 raft_consensus.cc:2267] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:04.072357 23126 consensus_peers.cc:487] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.073913 20003 tablet_replica.cc:331] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.074774 20003 raft_consensus.cc:2238] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.075251 20003 raft_consensus.cc:2267] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:04.075657 23126 consensus_peers.cc:487] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.077073 20003 tablet_replica.cc:331] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.077667 20003 raft_consensus.cc:2238] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.078440 20003 raft_consensus.cc:2267] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.080026 20003 tablet_replica.cc:331] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.080732 20003 raft_consensus.cc:2238] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.081152 20003 raft_consensus.cc:2267] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.083079 20003 tablet_replica.cc:331] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.083623 20003 raft_consensus.cc:2238] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.084347 20003 raft_consensus.cc:2267] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.085902 20003 tablet_replica.cc:331] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.086511 20003 raft_consensus.cc:2238] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.087286 20003 raft_consensus.cc:2267] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.089251 20003 tablet_replica.cc:331] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.089886 20003 raft_consensus.cc:2238] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.090742 20003 raft_consensus.cc:2267] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.092900 20003 tablet_replica.cc:331] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.093550 20003 raft_consensus.cc:2238] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.093969 20003 raft_consensus.cc:2267] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.095554 20003 tablet_replica.cc:331] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.096026 20003 raft_consensus.cc:2238] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.096383 20003 raft_consensus.cc:2267] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.098747 20003 tablet_replica.cc:331] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.099275 20003 raft_consensus.cc:2238] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.099618 20003 raft_consensus.cc:2267] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.101114 20003 tablet_replica.cc:331] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.101591 20003 raft_consensus.cc:2238] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.101949 20003 raft_consensus.cc:2267] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.103489 20003 tablet_replica.cc:331] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.103965 20003 raft_consensus.cc:2238] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.104773 20003 raft_consensus.cc:2267] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.106982 20003 tablet_replica.cc:331] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.107633 20003 raft_consensus.cc:2238] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.108078 20003 raft_consensus.cc:2267] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.109766 20003 tablet_replica.cc:331] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.110157 20003 raft_consensus.cc:2238] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.110769 20003 raft_consensus.cc:2267] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.113874 20003 tablet_replica.cc:331] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.114493 20003 raft_consensus.cc:2238] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:04.115319 20003 raft_consensus.cc:2267] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:04.116986 20003 tablet_replica.cc:331] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: stopping tablet replica
I20250109 21:11:04.117434 20003 raft_consensus.cc:2238] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:04.117782 20003 raft_consensus.cc:2267] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:04.183384 23051 consensus_peers.cc:487] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.188048 23126 consensus_peers.cc:487] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.192485 20003 tablet_server.cc:195] TabletServer@127.19.136.193:0 shutdown complete.
W20250109 21:11:04.213025 23051 consensus_peers.cc:487] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.217121 23051 consensus_peers.cc:487] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.220135 22976 consensus_peers.cc:487] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.231073 22976 consensus_peers.cc:487] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.239549 23051 consensus_peers.cc:487] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.246294 23126 consensus_peers.cc:487] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.256811 23051 consensus_peers.cc:487] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.259507 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:04.265441 23126 consensus_peers.cc:487] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.271031 23717 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:04.281425 23718 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:04.289475 22976 consensus_peers.cc:487] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.293987 23720 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:04.336220 20003 server_base.cc:1034] running on GCE node
I20250109 21:11:04.341173 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:11:04.341673 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:04.342140 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457064342112 us; error 0 us; skew 500 ppm
I20250109 21:11:04.343796 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
W20250109 21:11:04.382382 23051 consensus_peers.cc:487] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.386292 23051 consensus_peers.cc:487] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.394428 20003 webserver.cc:458] Webserver started at http://127.19.136.193:46707/ using document root <none> and password file <none>
W20250109 21:11:04.399243 23126 consensus_peers.cc:487] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.399648 20003 fs_manager.cc:362] Metadata directory not provided
W20250109 21:11:04.400015 23126 consensus_peers.cc:487] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.400666 20003 fs_manager.cc:365] Using existing metadata directory in first data directory
W20250109 21:11:04.406594 23126 consensus_peers.cc:487] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.414894 23126 consensus_peers.cc:487] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.424762 20003 fs_manager.cc:714] Time spent opening directory manager: real 0.022s user 0.011s sys 0.001s
W20250109 21:11:04.426826 22976 consensus_peers.cc:487] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.427497 22976 consensus_peers.cc:487] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.435990 23051 consensus_peers.cc:487] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.443065 23727 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:04.450183 20003 fs_manager.cc:730] Time spent opening block manager: real 0.010s user 0.002s sys 0.001s
I20250109 21:11:04.450608 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
uuid: "51679b9f547940b6a8311fd6fab340f7"
format_stamp: "Formatted at 2025-01-09 21:10:52 on dist-test-slave-sc47"
I20250109 21:11:04.451370 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.LeaderRebalancerTest.RestartTserver.1736456943481041-20003-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
W20250109 21:11:04.472056 23051 consensus_peers.cc:487] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.477339 22976 consensus_peers.cc:487] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:04.528774 23051 consensus_peers.cc:487] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:04.537042 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:04.539430 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:04.563747 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:11:04.579084 23734 ts_tablet_manager.cc:542] Loading tablet metadata (0/45 complete)
I20250109 21:11:04.933122 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (45 total tablets, 45 live tablets)
I20250109 21:11:04.933609 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.356s user 0.012s sys 0.000s
I20250109 21:11:04.933987 20003 ts_tablet_manager.cc:594] Registering tablets (0/45 complete)
I20250109 21:11:04.943879 23734 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:04.958456 23676 raft_consensus.cc:491] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:04.959362 23676 raft_consensus.cc:513] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:04.960917 23734 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:04.961863 23734 tablet_bootstrap.cc:492] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:04.962674 23734 ts_tablet_manager.cc:1397] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.019s user 0.017s sys 0.000s
I20250109 21:11:04.965876 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:11:04.970140 23051 leader_election.cc:336] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:04.970731 23051 leader_election.cc:304] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:04.964318 23676 leader_election.cc:290] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:04.985342 23738 raft_consensus.cc:2743] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:04.988737 23734 raft_consensus.cc:357] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:04.989779 23734 raft_consensus.cc:738] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:04.990936 23734 consensus_queue.cc:260] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.002219 23609 raft_consensus.cc:491] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.002771 23609 raft_consensus.cc:513] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:11:05.009882 23126 leader_election.cc:336] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.011471 23609 leader_election.cc:290] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.011919 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:05.013736 23124 leader_election.cc:304] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:05.014720 23609 raft_consensus.cc:2743] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.016600 23734 ts_tablet_manager.cc:1428] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.054s user 0.003s sys 0.004s
I20250109 21:11:05.017446 23734 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:05.049547 23609 raft_consensus.cc:491] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.050237 23609 raft_consensus.cc:513] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.052240 23609 leader_election.cc:290] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.055847 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:11:05.059191 23126 leader_election.cc:336] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.059566 23126 leader_election.cc:304] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:05.060153 23734 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:05.060636 23609 raft_consensus.cc:2743] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.061069 23734 tablet_bootstrap.cc:492] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:05.061767 23734 ts_tablet_manager.cc:1397] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.045s user 0.019s sys 0.002s
I20250109 21:11:05.064342 23734 raft_consensus.cc:357] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.065062 23734 raft_consensus.cc:738] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:05.069833 23734 consensus_queue.cc:260] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.071920 23734 ts_tablet_manager.cc:1428] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.010s user 0.005s sys 0.002s
I20250109 21:11:05.072629 23734 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:05.107430 23734 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:05.108371 23734 tablet_bootstrap.cc:492] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:05.108723 23723 raft_consensus.cc:491] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.108966 23734 ts_tablet_manager.cc:1397] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.037s user 0.013s sys 0.020s
I20250109 21:11:05.109313 23723 raft_consensus.cc:513] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.111294 23723 leader_election.cc:290] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.111640 23734 raft_consensus.cc:357] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.112505 23734 raft_consensus.cc:738] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:05.113216 23734 consensus_queue.cc:260] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.114619 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:05.115216 23081 raft_consensus.cc:2463] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:05.115504 23734 ts_tablet_manager.cc:1428] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20250109 21:11:05.116268 23734 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:05.116598 22975 leader_election.cc:304] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.120057 23668 raft_consensus.cc:2798] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election won for term 2
W20250109 21:11:05.120270 22976 leader_election.cc:336] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.120425 23668 raft_consensus.cc:491] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.120787 23668 raft_consensus.cc:3054] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.123492 23723 raft_consensus.cc:491] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.124069 23723 raft_consensus.cc:513] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.126160 23723 leader_election.cc:290] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.128033 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316cfec4ecf4f989132abc75c89a161" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.128845 23668 raft_consensus.cc:513] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:11:05.131662 22976 leader_election.cc:336] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.136397 23668 leader_election.cc:290] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.136580 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ef674a6d97ef453288aac671f539707c" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:05.137195 23081 raft_consensus.cc:3054] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.138453 22976 leader_election.cc:304] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.139993 23668 raft_consensus.cc:2743] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.158893 23081 raft_consensus.cc:2463] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:05.160036 22975 leader_election.cc:304] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.160722 23668 raft_consensus.cc:2798] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.161188 23668 raft_consensus.cc:695] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:05.162108 23668 consensus_queue.cc:237] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:11:05.165905 22976 leader_election.cc:336] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.174181 23734 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:05.178601 23734 tablet_bootstrap.cc:492] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:05.180200 23734 ts_tablet_manager.cc:1397] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.064s user 0.023s sys 0.009s
I20250109 21:11:05.185041 23734 raft_consensus.cc:357] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.187204 23734 raft_consensus.cc:738] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:05.188676 23734 consensus_queue.cc:260] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.192312 23734 ts_tablet_manager.cc:1428] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.011s user 0.004s sys 0.000s
I20250109 21:11:05.197256 23734 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:05.198160 23655 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.198690 23655 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.200592 23655 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.202721 22833 catalog_manager.cc:5526] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 2 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:05.205550 23668 raft_consensus.cc:491] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
W20250109 21:11:05.206241 23126 leader_election.cc:336] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.206218 23668 raft_consensus.cc:513] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.207966 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:05.209453 23125 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:05.209865 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.210536 23157 raft_consensus.cc:2463] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:05.210852 23655 raft_consensus.cc:2743] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:05.214198 22976 leader_election.cc:304] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
W20250109 21:11:05.215107 22976 leader_election.cc:336] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.215103 23723 raft_consensus.cc:2798] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.215653 23723 raft_consensus.cc:491] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.215770 23668 leader_election.cc:290] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.216022 23723 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.224061 23723 raft_consensus.cc:513] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.231285 23739 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.231841 23739 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.234063 23739 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.236310 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.236955 23157 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 2.
I20250109 21:11:05.237742 23739 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.238063 20003 ts_tablet_manager.cc:610] Registered 45 tablets
I20250109 21:11:05.238355 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.304s user 0.250s sys 0.000s
I20250109 21:11:05.239086 23668 raft_consensus.cc:491] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.239993 23051 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.239677 23668 raft_consensus.cc:513] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.241420 23644 raft_consensus.cc:2798] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:05.241799 23644 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.242111 23668 leader_election.cc:290] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.242132 23644 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:05.248649 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:11:05.249984 22976 leader_election.cc:336] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.238237 23739 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:11:05.250603 23051 leader_election.cc:336] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.251912 22975 leader_election.cc:304] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:05.253206 23735 raft_consensus.cc:2743] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.258404 23739 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.259868 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.274528 23668 raft_consensus.cc:491] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.275210 23668 raft_consensus.cc:513] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.277494 23668 leader_election.cc:290] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.281075 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.281680 23160 raft_consensus.cc:2463] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:05.283460 22976 leader_election.cc:304] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:05.284176 23735 raft_consensus.cc:2798] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.284641 23735 raft_consensus.cc:491] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.285065 23735 raft_consensus.cc:3054] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.258054 23644 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.287051 23644 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.291402 23739 raft_consensus.cc:491] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.291857 23739 raft_consensus.cc:513] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
W20250109 21:11:05.292929 22976 leader_election.cc:336] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.293601 23739 leader_election.cc:290] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:05.300546 23735 raft_consensus.cc:513] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.304409 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5ebf49030ef4421098214f70740e598f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:05.304983 23160 raft_consensus.cc:3054] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:05.309988 22976 leader_election.cc:336] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.311316 23735 leader_election.cc:290] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.320523 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:05.321137 23157 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.329089 23157 raft_consensus.cc:2463] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:05.330334 22976 leader_election.cc:304] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:05.331235 23735 raft_consensus.cc:2798] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.331866 23735 raft_consensus.cc:695] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:05.332942 23735 consensus_queue.cc:237] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.336181 23668 raft_consensus.cc:491] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
W20250109 21:11:05.336548 22976 leader_election.cc:336] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
W20250109 21:11:05.338198 23051 leader_election.cc:336] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.336839 23668 raft_consensus.cc:513] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.338752 23051 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.339555 23723 leader_election.cc:290] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.340399 23160 raft_consensus.cc:2463] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:05.340854 23668 leader_election.cc:290] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.342082 23741 raft_consensus.cc:2743] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.348158 22976 leader_election.cc:304] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.349750 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.350622 23610 raft_consensus.cc:491] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.351949 23610 raft_consensus.cc:513] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.359799 23610 leader_election.cc:290] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.360718 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:05.366150 23160 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:05.365376 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.378484 23735 raft_consensus.cc:2798] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.379184 23735 raft_consensus.cc:695] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:05.380113 23735 consensus_queue.cc:237] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.383369 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:05.384205 23007 raft_consensus.cc:2463] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:05.386991 23610 raft_consensus.cc:491] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.387696 23610 raft_consensus.cc:513] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.388579 23736 raft_consensus.cc:491] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.389180 23736 raft_consensus.cc:513] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.392149 23610 leader_election.cc:290] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.393595 23049 leader_election.cc:304] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.394348 23741 raft_consensus.cc:2798] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.394686 23741 raft_consensus.cc:491] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.395035 23741 raft_consensus.cc:3054] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.396136 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:05.396811 23007 raft_consensus.cc:2463] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:05.397321 23609 raft_consensus.cc:491] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.397882 23609 raft_consensus.cc:513] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.399513 23736 leader_election.cc:290] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.400120 23609 leader_election.cc:290] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.404732 23049 leader_election.cc:304] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.405498 23739 raft_consensus.cc:2798] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election won for term 2
W20250109 21:11:05.405553 23126 leader_election.cc:336] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.407949 23739 raft_consensus.cc:491] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.402555 23741 raft_consensus.cc:513] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.408399 23739 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.408499 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:05.409765 23125 leader_election.cc:304] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:05.410871 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1df676409e0c4c1ca1dc047d238e4a14" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:05.411545 23007 raft_consensus.cc:3054] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.411103 23609 raft_consensus.cc:2743] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.416806 23609 raft_consensus.cc:491] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.416857 23739 raft_consensus.cc:513] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.417392 23609 raft_consensus.cc:513] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.418987 23741 leader_election.cc:290] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.418787 23007 raft_consensus.cc:2463] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 2.
I20250109 21:11:05.420765 23049 leader_election.cc:304] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.421685 23741 raft_consensus.cc:2798] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.422835 23741 raft_consensus.cc:695] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
W20250109 21:11:05.429845 22976 leader_election.cc:336] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.430295 22976 leader_election.cc:304] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
W20250109 21:11:05.430943 23126 leader_election.cc:336] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.431243 23160 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 3.
W20250109 21:11:05.429288 23051 leader_election.cc:336] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
W20250109 21:11:05.432500 23051 leader_election.cc:336] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.432863 23051 leader_election.cc:304] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
W20250109 21:11:05.434867 23051 leader_election.cc:336] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.435235 23644 raft_consensus.cc:2743] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.439107 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:05.439857 23081 raft_consensus.cc:2388] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate df8c84b03e6f4a5288bdad949ba2447c in current term 2: Already voted for candidate e1a492f3cf3a4827bb0045500a3abb83 in this term.
I20250109 21:11:05.423450 23739 leader_election.cc:290] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.442970 23734 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:05.446368 23644 raft_consensus.cc:491] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.445056 23051 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.434514 23723 raft_consensus.cc:2743] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.448642 23644 raft_consensus.cc:513] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.449416 23546 raft_consensus.cc:491] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.449918 23546 raft_consensus.cc:513] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.450472 23644 leader_election.cc:290] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.451876 23546 leader_election.cc:290] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:11:05.455219 23051 leader_election.cc:336] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.455449 23734 tablet_bootstrap.cc:492] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:05.456107 23734 ts_tablet_manager.cc:1397] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.259s user 0.028s sys 0.028s
I20250109 21:11:05.446214 23609 leader_election.cc:290] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:11:05.459856 22976 leader_election.cc:336] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.460552 22975 leader_election.cc:304] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:05.446506 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:05.454850 23739 raft_consensus.cc:2798] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:05.464794 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:05.469686 23734 raft_consensus.cc:357] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.470361 23734 raft_consensus.cc:738] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:05.462999 23723 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.463819 23741 consensus_queue.cc:237] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.479013 23734 consensus_queue.cc:260] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.482066 23756 raft_consensus.cc:491] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
W20250109 21:11:05.484957 23126 leader_election.cc:336] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.486333 23734 ts_tablet_manager.cc:1428] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.030s user 0.005s sys 0.003s
I20250109 21:11:05.489041 23734 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:05.487069 23125 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 50173.9us
I20250109 21:11:05.491417 23736 raft_consensus.cc:491] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
W20250109 21:11:05.483862 23124 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 54915.9us
I20250109 21:11:05.482692 23756 raft_consensus.cc:513] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.486181 23609 raft_consensus.cc:491] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
W20250109 21:11:05.494035 23051 leader_election.cc:336] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.491922 23736 raft_consensus.cc:513] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.495599 23609 raft_consensus.cc:513] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
W20250109 21:11:05.495339 23051 leader_election.cc:336] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.497586 23736 leader_election.cc:290] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.496654 23739 raft_consensus.cc:695] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:05.498180 23609 leader_election.cc:290] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.499298 23739 consensus_queue.cc:237] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:11:05.506856 23051 leader_election.cc:336] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.507328 23051 leader_election.cc:304] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:05.507692 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:05.507993 23644 raft_consensus.cc:2743] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.507622 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316cfec4ecf4f989132abc75c89a161" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:05.509253 23010 raft_consensus.cc:2463] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:05.507119 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:11:05.512691 22976 leader_election.cc:336] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.513021 22976 leader_election.cc:304] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:05.514551 23735 raft_consensus.cc:2743] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.515746 23723 raft_consensus.cc:2743] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.518481 23758 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.520859 23124 leader_election.cc:304] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.498780 23756 leader_election.cc:290] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.522267 23655 raft_consensus.cc:2798] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.523416 23124 leader_election.cc:304] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:05.524117 23655 raft_consensus.cc:491] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.525086 23655 raft_consensus.cc:3054] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:05.525898 23126 leader_election.cc:336] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
W20250109 21:11:05.527264 23126 leader_election.cc:336] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.529033 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:05.529538 23009 raft_consensus.cc:2463] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:05.530460 23723 raft_consensus.cc:491] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.531973 23723 raft_consensus.cc:513] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.536505 23741 raft_consensus.cc:491] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.543473 23741 raft_consensus.cc:513] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.544097 23124 leader_election.cc:304] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.545166 23755 raft_consensus.cc:2798] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.545600 23755 raft_consensus.cc:491] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.545686 23738 raft_consensus.cc:491] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.546008 23755 raft_consensus.cc:3054] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.527710 23756 raft_consensus.cc:2743] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:05.546206 23738 raft_consensus.cc:513] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.559155 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.560657 23160 raft_consensus.cc:2463] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:05.561403 23723 leader_election.cc:290] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:05.561772 23738 leader_election.cc:290] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.562597 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:05.563268 23009 raft_consensus.cc:2463] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:05.564644 23049 leader_election.cc:304] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.565467 23740 raft_consensus.cc:2798] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.565829 23740 raft_consensus.cc:491] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.566180 23740 raft_consensus.cc:3054] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:05.566553 22976 leader_election.cc:336] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.569864 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:05.571450 23668 raft_consensus.cc:491] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.572007 23668 raft_consensus.cc:513] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.573895 23668 leader_election.cc:290] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.578357 23740 raft_consensus.cc:513] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:11:05.579363 22976 leader_election.cc:336] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.584393 23051 leader_election.cc:304] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.590701 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "125b38b701634accb2448016a89bc27f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:05.591296 23009 raft_consensus.cc:3054] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.593977 23740 leader_election.cc:290] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.600224 22833 catalog_manager.cc:5526] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 2 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:05.602052 22833 catalog_manager.cc:5526] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 2 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } }
W20250109 21:11:05.604003 22976 consensus_peers.cc:487] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:05.597934 23009 raft_consensus.cc:2463] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 2.
I20250109 21:11:05.605226 23049 leader_election.cc:304] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.606465 23157 raft_consensus.cc:2463] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
W20250109 21:11:05.608739 23051 leader_election.cc:336] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.606868 23741 leader_election.cc:290] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.604975 23738 raft_consensus.cc:2798] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.521778 23758 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.613931 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:05.618536 23081 raft_consensus.cc:2463] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:05.607266 23676 raft_consensus.cc:2798] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.626171 23084 raft_consensus.cc:1270] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:05.630415 23007 raft_consensus.cc:2463] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 2.
I20250109 21:11:05.634856 23049 leader_election.cc:304] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.635018 22976 leader_election.cc:304] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.636904 23676 raft_consensus.cc:695] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:05.637050 23610 raft_consensus.cc:2798] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.637786 23610 raft_consensus.cc:695] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:05.637885 23676 consensus_queue.cc:237] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.638998 23610 consensus_queue.cc:237] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.640468 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:05.641557 22975 leader_election.cc:304] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
W20250109 21:11:05.636934 23051 leader_election.cc:336] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.615250 23738 raft_consensus.cc:491] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.645603 23723 raft_consensus.cc:2798] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.647713 23738 raft_consensus.cc:3054] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.649106 23723 raft_consensus.cc:491] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.649263 23653 consensus_queue.cc:1035] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20250109 21:11:05.649663 23723 raft_consensus.cc:3054] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.645089 23668 raft_consensus.cc:2798] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.651085 23668 raft_consensus.cc:491] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.651468 23668 raft_consensus.cc:3054] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:05.652871 23051 leader_election.cc:336] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.653477 23755 raft_consensus.cc:513] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.638082 23758 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.656296 23755 leader_election.cc:290] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.647449 23084 raft_consensus.cc:2463] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
W20250109 21:11:05.657313 23126 leader_election.cc:336] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.664314 23738 raft_consensus.cc:513] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.668192 23738 leader_election.cc:290] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:05.667518 22832 catalog_manager.cc:5526] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
W20250109 21:11:05.667140 23126 leader_election.cc:336] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.672169 23157 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:05.672909 23157 raft_consensus.cc:3054] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.681015 23668 raft_consensus.cc:513] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.688215 23723 raft_consensus.cc:513] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.690132 23723 leader_election.cc:290] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.694118 23125 leader_election.cc:304] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.695107 23756 raft_consensus.cc:2798] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:05.695216 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:05.696096 23080 raft_consensus.cc:2463] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:05.697227 23734 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:05.695544 23756 raft_consensus.cc:491] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:05.697664 23756 raft_consensus.cc:3054] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.698391 23734 tablet_bootstrap.cc:492] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:05.698465 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1a650b5afdf747e5b2efa98da645c5ed" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:05.699182 23734 ts_tablet_manager.cc:1397] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.212s user 0.031s sys 0.020s
I20250109 21:11:05.699976 23081 raft_consensus.cc:3054] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.701730 23734 raft_consensus.cc:357] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:05.702451 23734 raft_consensus.cc:738] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:05.675601 23007 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c6bf7b2897e84ca68fca53cc84d8a95b" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:05.728507 23007 raft_consensus.cc:3054] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:05.788359 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 83619.9us
I20250109 21:11:05.793814 23157 raft_consensus.cc:2463] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 2.
I20250109 21:11:05.797049 23081 raft_consensus.cc:2463] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:05.802187 23734 consensus_queue.cc:260] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:05.805580 23734 ts_tablet_manager.cc:1428] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.106s user 0.006s sys 0.000s
I20250109 21:11:05.806330 23734 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:05.806726 22976 leader_election.cc:336] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.811125 23051 leader_election.cc:304] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.815783 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "a6503cd8bad54600a24017cfeed153d1" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:05.816432 23160 raft_consensus.cc:3054] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.820101 23644 raft_consensus.cc:2798] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.804895 23668 leader_election.cc:290] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:05.815783 23655 raft_consensus.cc:513] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:05.825531 23655 leader_election.cc:290] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:05.805114 23756 raft_consensus.cc:513] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:05.828644 23756 leader_election.cc:290] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Requested vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:05.830767 23007 raft_consensus.cc:2463] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 2.
I20250109 21:11:05.848222 23160 raft_consensus.cc:2463] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:05.850083 23644 raft_consensus.cc:695] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:05.851562 23644 consensus_queue.cc:237] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:05.859967 22975 leader_election.cc:304] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:05.861260 22976 leader_election.cc:304] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.861421 23124 leader_election.cc:304] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:05.864876 23736 raft_consensus.cc:2798] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.869345 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d316cfec4ecf4f989132abc75c89a161" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
W20250109 21:11:05.882969 23051 leader_election.cc:336] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.863724 23723 raft_consensus.cc:2798] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.863960 23758 raft_consensus.cc:2798] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:05.895598 23723 raft_consensus.cc:695] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:05.896629 23723 consensus_queue.cc:237] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:05.910401 23734 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:05.886708 23010 raft_consensus.cc:3054] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:05.911988 22976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 49322.5us
W20250109 21:11:05.913683 22976 leader_election.cc:336] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
W20250109 21:11:05.915864 23049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 201134us
I20250109 21:11:05.918735 23157 raft_consensus.cc:1270] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 2 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250109 21:11:05.910415 23758 raft_consensus.cc:695] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:05.920406 23734 tablet_bootstrap.cc:492] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:05.940657 23734 ts_tablet_manager.cc:1397] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.134s user 0.022s sys 0.015s
I20250109 21:11:05.923681 23761 consensus_queue.cc:1035] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:05.930720 23008 raft_consensus.cc:1270] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:05.944634 22832 catalog_manager.cc:5526] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 2 to 3, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 3 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:05.948061 22832 catalog_manager.cc:5526] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:05.952709 22832 catalog_manager.cc:5526] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:05.941615 23736 raft_consensus.cc:695] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:05.939678 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f7fab26983594ff9be82f13812a1e49f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:05.977224 23084 raft_consensus.cc:3054] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:05.986686 23736 consensus_queue.cc:237] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:11:05.987723 23126 leader_election.cc:336] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
W20250109 21:11:05.988283 23126 leader_election.cc:336] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
I20250109 21:11:05.996559 23758 consensus_queue.cc:237] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:11:05.985308 23772 log.cc:926] Time spent T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83: Append to log took a long time: real 0.120s user 0.000s sys 0.000s
W20250109 21:11:06.009577 23051 consensus_peers.cc:487] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.012217 23734 raft_consensus.cc:357] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.012960 23734 raft_consensus.cc:738] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.013592 23734 consensus_queue.cc:260] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.014196 23125 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
W20250109 21:11:06.015544 23051 consensus_peers.cc:487] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.020777 23084 raft_consensus.cc:2463] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 2.
W20250109 21:11:06.025566 23049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 73239.8us
I20250109 21:11:06.037895 23152 raft_consensus.cc:1270] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.026516 23609 raft_consensus.cc:2798] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:06.039288 23609 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 51679b9f547940b6a8311fd6fab340f7)
I20250109 21:11:06.039649 23609 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:06.035194 23741 consensus_queue.cc:1035] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.006s
I20250109 21:11:06.047689 23734 ts_tablet_manager.cc:1428] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.107s user 0.006s sys 0.001s
I20250109 21:11:06.048744 23734 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:06.068017 23152 raft_consensus.cc:1270] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.068442 23125 leader_election.cc:304] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:06.069979 23756 raft_consensus.cc:2798] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:06.070479 23756 raft_consensus.cc:695] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:06.071336 23756 consensus_queue.cc:237] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:06.042428 23010 raft_consensus.cc:2463] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 2.
I20250109 21:11:06.101028 22832 catalog_manager.cc:5526] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:06.107662 23723 consensus_queue.cc:1035] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:06.111987 22833 catalog_manager.cc:5526] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 2 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:06.114521 23008 raft_consensus.cc:1270] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.122843 23609 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.124794 23609 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:06.128923 23791 consensus_queue.cc:1035] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20250109 21:11:06.130457 22976 consensus_peers.cc:487] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:06.130981 22976 consensus_peers.cc:487] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.134219 23124 leader_election.cc:304] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:06.137679 22833 catalog_manager.cc:5526] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:06.140300 23763 raft_consensus.cc:2798] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:06.142580 23763 raft_consensus.cc:695] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:06.143551 23763 consensus_queue.cc:237] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:11:06.154556 23126 leader_election.cc:336] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: RPC error from VoteRequest() call to peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111)
W20250109 21:11:06.160748 23051 consensus_peers.cc:487] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.183729 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:06.184388 23084 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:06.187044 23792 consensus_queue.cc:1035] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.007s
W20250109 21:11:06.225322 23051 consensus_peers.cc:487] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.226109 22832 catalog_manager.cc:5526] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 2 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
W20250109 21:11:06.235077 22976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.193:44075, user_credentials={real_user=slave}} blocked reactor thread for 87622.2us
I20250109 21:11:06.241552 23010 raft_consensus.cc:1270] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.253109 23084 raft_consensus.cc:2463] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 2.
I20250109 21:11:06.255877 23739 consensus_queue.cc:1035] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
W20250109 21:11:06.272291 23051 consensus_peers.cc:487] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.279148 23125 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:06.280202 23756 raft_consensus.cc:2798] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:06.280786 23756 raft_consensus.cc:695] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:06.281644 23756 consensus_queue.cc:237] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.284894 22830 catalog_manager.cc:5526] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:06.296041 22830 catalog_manager.cc:5526] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:06.298751 23734 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.300501 23734 tablet_bootstrap.cc:492] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:06.301318 23734 ts_tablet_manager.cc:1397] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.253s user 0.026s sys 0.009s
I20250109 21:11:06.305370 23734 raft_consensus.cc:357] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.306200 23734 raft_consensus.cc:738] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.308590 23160 raft_consensus.cc:1270] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.312449 23734 consensus_queue.cc:260] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.312932 23783 consensus_queue.cc:1035] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:06.317977 23734 ts_tablet_manager.cc:1428] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.016s user 0.007s sys 0.000s
I20250109 21:11:06.318823 23734 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:06.342017 23734 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.343012 23734 tablet_bootstrap.cc:492] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:06.343734 23734 ts_tablet_manager.cc:1397] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.004s
I20250109 21:11:06.343884 23084 raft_consensus.cc:1270] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.347107 23735 consensus_queue.cc:1035] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:06.372758 22833 catalog_manager.cc:5526] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 1 to 2, leader changed from 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193) to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:06.376310 23734 raft_consensus.cc:357] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.377285 23734 raft_consensus.cc:738] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.379412 23734 consensus_queue.cc:260] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.381503 23734 ts_tablet_manager.cc:1428] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.037s user 0.005s sys 0.000s
I20250109 21:11:06.382176 23734 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:06.399370 22976 consensus_peers.cc:487] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.401615 23152 raft_consensus.cc:1270] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20250109 21:11:06.413311 22976 consensus_peers.cc:487] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:06.417789 23126 consensus_peers.cc:487] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.419816 23735 consensus_queue.cc:1035] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:06.427830 23734 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.428777 23734 tablet_bootstrap.cc:492] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:06.429563 23734 ts_tablet_manager.cc:1397] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.048s user 0.013s sys 0.000s
I20250109 21:11:06.432319 23734 raft_consensus.cc:357] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.433399 23734 raft_consensus.cc:738] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.434084 23734 consensus_queue.cc:260] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.436657 23734 ts_tablet_manager.cc:1428] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250109 21:11:06.437438 23734 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:06.448549 23051 consensus_peers.cc:487] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:06.476578 22976 consensus_peers.cc:487] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.478580 23742 raft_consensus.cc:491] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:06.479036 23742 raft_consensus.cc:513] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
W20250109 21:11:06.490430 23126 consensus_peers.cc:487] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:06.491787 23051 consensus_peers.cc:487] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:06.497040 23126 consensus_peers.cc:487] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.497939 23742 leader_election.cc:290] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:06.509052 23742 raft_consensus.cc:491] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:06.509462 23742 raft_consensus.cc:513] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:11:06.511534 23126 consensus_peers.cc:487] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.519273 23742 leader_election.cc:290] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:06.529942 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e82f7c977e4539b1368607513bc151" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:06.535665 23742 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:06.536361 23742 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.539670 23742 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
W20250109 21:11:06.576792 23126 consensus_peers.cc:487] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.577682 23734 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.578637 23734 tablet_bootstrap.cc:492] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
W20250109 21:11:06.579162 23051 consensus_peers.cc:487] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.580367 23742 raft_consensus.cc:491] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:06.580878 23742 raft_consensus.cc:513] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.583492 23742 leader_election.cc:290] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:06.583493 23734 ts_tablet_manager.cc:1397] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.146s user 0.022s sys 0.044s
I20250109 21:11:06.584537 23010 raft_consensus.cc:1270] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer 227e48f30ae84db6bff43cc2860219a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.584581 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
W20250109 21:11:06.590157 22976 consensus_peers.cc:487] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:06.602102 23126 consensus_peers.cc:487] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.603040 23756 consensus_queue.cc:1035] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:06.586630 23734 raft_consensus.cc:357] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.606122 23734 raft_consensus.cc:738] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
W20250109 21:11:06.606868 23051 consensus_peers.cc:487] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.609591 23734 consensus_queue.cc:260] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.614370 23734 ts_tablet_manager.cc:1428] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.030s user 0.005s sys 0.000s
I20250109 21:11:06.615177 23734 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:06.609968 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c8e82f7c977e4539b1368607513bc151" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:06.611213 23160 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:11:06.635982 23126 consensus_peers.cc:487] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:06.649251 23126 consensus_peers.cc:487] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.658105 23010 raft_consensus.cc:1270] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer 227e48f30ae84db6bff43cc2860219a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
W20250109 21:11:06.667464 23051 consensus_peers.cc:487] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:06.670588 22976 consensus_peers.cc:487] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.672156 23763 consensus_queue.cc:1035] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
W20250109 21:11:06.684055 23126 consensus_peers.cc:487] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.698953 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:06.700724 23731 leader_election.cc:304] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:06.701952 23742 raft_consensus.cc:2743] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250109 21:11:06.709764 23126 consensus_peers.cc:487] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.710731 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:06.711256 23080 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:06.713022 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:06.713472 23081 raft_consensus.cc:1270] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 227e48f30ae84db6bff43cc2860219a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.714463 23083 raft_consensus.cc:1270] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 227e48f30ae84db6bff43cc2860219a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:06.713393 23730 leader_election.cc:304] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:06.717238 23730 leader_election.cc:304] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:06.718704 23742 raft_consensus.cc:2743] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:06.719457 23742 raft_consensus.cc:2743] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
W20250109 21:11:06.725024 23051 consensus_peers.cc:487] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.726037 23756 consensus_queue.cc:1035] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:06.728258 23756 consensus_queue.cc:1035] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:06.730156 23731 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:06.731086 23742 raft_consensus.cc:2743] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250109 21:11:06.751585 22976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 56253.4us
W20250109 21:11:06.769333 23051 consensus_peers.cc:487] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.771797 23734 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.773087 23734 tablet_bootstrap.cc:492] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
W20250109 21:11:06.773469 23126 consensus_peers.cc:487] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.773960 23734 ts_tablet_manager.cc:1397] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.159s user 0.053s sys 0.040s
I20250109 21:11:06.776459 23734 raft_consensus.cc:357] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:11:06.777971 23126 consensus_peers.cc:487] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:06.784168 23734 raft_consensus.cc:738] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.785192 23734 consensus_queue.cc:260] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
W20250109 21:11:06.788703 23051 consensus_peers.cc:487] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:06.791055 23126 consensus_peers.cc:487] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.793890 23734 ts_tablet_manager.cc:1428] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.020s user 0.005s sys 0.000s
I20250109 21:11:06.794728 23734 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:06.823315 23051 consensus_peers.cc:487] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.825574 23734 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.826694 23734 tablet_bootstrap.cc:492] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:06.827425 23734 ts_tablet_manager.cc:1397] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.033s user 0.012s sys 0.010s
I20250109 21:11:06.829982 23734 raft_consensus.cc:357] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.830791 23734 raft_consensus.cc:738] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.831626 23734 consensus_queue.cc:260] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.834161 23734 ts_tablet_manager.cc:1428] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:11:06.835003 23734 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:06.856151 23126 consensus_peers.cc:487] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.859112 23734 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.860172 23734 tablet_bootstrap.cc:492] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:06.860934 23734 ts_tablet_manager.cc:1397] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.026s user 0.017s sys 0.004s
I20250109 21:11:06.863448 23734 raft_consensus.cc:357] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:06.864253 23734 raft_consensus.cc:738] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.865070 23846 raft_consensus.cc:491] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:06.865541 23846 raft_consensus.cc:513] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.867592 23846 leader_election.cc:290] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:06.869222 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:06.869364 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "46e8872c00294570b6f9beecbcffa034" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:06.871894 23730 leader_election.cc:304] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:06.873200 23846 raft_consensus.cc:2743] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:06.874055 23734 consensus_queue.cc:260] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:06.876811 23734 ts_tablet_manager.cc:1428] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.016s user 0.005s sys 0.000s
I20250109 21:11:06.877595 23734 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:06.879680 23051 consensus_peers.cc:487] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.897503 23734 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.898511 23734 tablet_bootstrap.cc:492] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
W20250109 21:11:06.898581 23051 consensus_peers.cc:487] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.899235 23734 ts_tablet_manager.cc:1397] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.022s user 0.017s sys 0.000s
I20250109 21:11:06.901969 23734 raft_consensus.cc:357] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.902696 23734 raft_consensus.cc:738] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.903405 23734 consensus_queue.cc:260] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:06.905717 23734 ts_tablet_manager.cc:1428] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:11:06.906508 23734 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:06.925100 23126 consensus_peers.cc:487] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:06.936687 23734 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:06.938194 23734 tablet_bootstrap.cc:492] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:06.938854 23734 ts_tablet_manager.cc:1397] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.009s
I20250109 21:11:06.952420 23734 raft_consensus.cc:357] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.953091 23734 raft_consensus.cc:738] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:06.953716 23734 consensus_queue.cc:260] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:06.955797 23734 ts_tablet_manager.cc:1428] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.017s user 0.005s sys 0.000s
I20250109 21:11:06.956532 23734 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.015082 23734 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.015988 23734 tablet_bootstrap.cc:492] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.016582 23734 ts_tablet_manager.cc:1397] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.060s user 0.012s sys 0.015s
I20250109 21:11:07.018826 23734 raft_consensus.cc:357] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.019524 23734 raft_consensus.cc:738] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.020179 23734 consensus_queue.cc:260] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.022332 23734 ts_tablet_manager.cc:1428] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.005s user 0.005s sys 0.000s
I20250109 21:11:07.023036 23734 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.038697 23875 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.193:44075 every 8 connection(s)
I20250109 21:11:07.039031 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.193:44075
I20250109 21:11:07.066195 23734 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.067250 23734 tablet_bootstrap.cc:492] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.067875 23734 ts_tablet_manager.cc:1397] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.045s user 0.014s sys 0.002s
I20250109 21:11:07.070139 23734 raft_consensus.cc:357] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:07.070807 23734 raft_consensus.cc:738] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.075712 23734 consensus_queue.cc:260] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:07.078671 23734 ts_tablet_manager.cc:1428] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20250109 21:11:07.079553 23734 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.079560 23842 raft_consensus.cc:3054] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:07.089069 23840 raft_consensus.cc:3054] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:07.090173 22976 consensus_peers.cc:487] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:07.107380 23879 heartbeater.cc:346] Connected to a master server at 127.19.136.254:39877
I20250109 21:11:07.107517 23734 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.107869 23879 heartbeater.cc:463] Registering TS with master...
I20250109 21:11:07.108862 23734 tablet_bootstrap.cc:492] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.109630 23734 ts_tablet_manager.cc:1397] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.030s user 0.014s sys 0.005s
I20250109 21:11:07.113258 23734 raft_consensus.cc:357] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.114995 23734 raft_consensus.cc:738] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.108855 23879 heartbeater.cc:510] Master 127.19.136.254:39877 requested a full tablet report, sending...
I20250109 21:11:07.115612 23734 consensus_queue.cc:260] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.117398 23734 ts_tablet_manager.cc:1428] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.004s sys 0.000s
I20250109 21:11:07.118201 23734 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.142351 23734 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.143460 23734 tablet_bootstrap.cc:492] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.144143 23734 ts_tablet_manager.cc:1397] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.026s user 0.009s sys 0.012s
I20250109 21:11:07.146610 23734 raft_consensus.cc:357] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.147368 23734 raft_consensus.cc:738] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.148170 23734 consensus_queue.cc:260] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.152326 23734 ts_tablet_manager.cc:1428] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.004s sys 0.004s
I20250109 21:11:07.153002 23734 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
W20250109 21:11:07.160362 22976 consensus_peers.cc:487] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:07.209419 22976 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 46081.7us
I20250109 21:11:07.238298 23837 raft_consensus.cc:3054] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:07.241235 23840 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:07.277143 23051 consensus_peers.cc:487] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
W20250109 21:11:07.308218 23126 consensus_peers.cc:487] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:07.313732 22830 ts_manager.cc:194] Re-registered known tserver with Master: 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
W20250109 21:11:07.334246 23049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 47335.8us
I20250109 21:11:07.334878 23836 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:07.349630 23734 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.354935 23734 tablet_bootstrap.cc:492] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.362354 23734 ts_tablet_manager.cc:1397] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.209s user 0.012s sys 0.012s
W20250109 21:11:07.364847 23051 consensus_peers.cc:487] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:07.364895 23734 raft_consensus.cc:357] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.372951 23734 raft_consensus.cc:738] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.373661 23734 consensus_queue.cc:260] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.376298 23734 ts_tablet_manager.cc:1428] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.013s user 0.004s sys 0.000s
I20250109 21:11:07.377079 23734 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.395599 23734 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.396271 23734 tablet_bootstrap.cc:492] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.397136 23734 ts_tablet_manager.cc:1397] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.000s
I20250109 21:11:07.399253 23734 raft_consensus.cc:357] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:07.399751 23734 raft_consensus.cc:738] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.400245 23734 consensus_queue.cc:260] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:07.400673 22830 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:43748
I20250109 21:11:07.401826 23734 ts_tablet_manager.cc:1428] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.004s user 0.002s sys 0.000s
I20250109 21:11:07.403282 23734 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.404816 23836 raft_consensus.cc:3054] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:07.405584 23879 heartbeater.cc:502] Master 127.19.136.254:39877 was elected leader, sending a full tablet report...
I20250109 21:11:07.421900 23734 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.422744 23734 tablet_bootstrap.cc:492] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.423384 23734 ts_tablet_manager.cc:1397] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.020s user 0.015s sys 0.000s
I20250109 21:11:07.425379 23734 raft_consensus.cc:357] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:07.425838 23734 raft_consensus.cc:738] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.426370 23734 consensus_queue.cc:260] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:07.428179 23734 ts_tablet_manager.cc:1428] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250109 21:11:07.428877 23734 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.444959 23734 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.445772 23734 tablet_bootstrap.cc:492] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.446341 23734 ts_tablet_manager.cc:1397] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.004s
I20250109 21:11:07.448710 23734 raft_consensus.cc:357] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:07.449400 23734 raft_consensus.cc:738] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.450030 23734 consensus_queue.cc:260] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:07.452446 23734 ts_tablet_manager.cc:1428] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250109 21:11:07.453140 23734 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.468111 23734 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.468984 23734 tablet_bootstrap.cc:492] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.469547 23734 ts_tablet_manager.cc:1397] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.017s user 0.010s sys 0.004s
I20250109 21:11:07.471845 23734 raft_consensus.cc:357] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.472553 23734 raft_consensus.cc:738] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.473169 23734 consensus_queue.cc:260] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.475495 23734 ts_tablet_manager.cc:1428] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250109 21:11:07.476207 23734 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.496615 23734 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.497475 23734 tablet_bootstrap.cc:492] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.498077 23734 ts_tablet_manager.cc:1397] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.004s
I20250109 21:11:07.502950 23734 raft_consensus.cc:357] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.503720 23734 raft_consensus.cc:738] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.504374 23734 consensus_queue.cc:260] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.507897 23734 ts_tablet_manager.cc:1428] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250109 21:11:07.509320 23734 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.553241 23836 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:07.573678 23734 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.574818 23734 tablet_bootstrap.cc:492] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.576661 23734 ts_tablet_manager.cc:1397] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.068s user 0.029s sys 0.031s
I20250109 21:11:07.581125 23734 raft_consensus.cc:357] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.581775 23734 raft_consensus.cc:738] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.582480 23734 consensus_queue.cc:260] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.584807 23734 ts_tablet_manager.cc:1428] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.004s sys 0.000s
I20250109 21:11:07.585461 23734 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.645828 23734 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.646803 23734 tablet_bootstrap.cc:492] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.647521 23734 ts_tablet_manager.cc:1397] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.062s user 0.027s sys 0.022s
I20250109 21:11:07.649719 23734 raft_consensus.cc:357] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:07.650467 23734 raft_consensus.cc:738] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.653033 23734 consensus_queue.cc:260] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:07.654970 23734 ts_tablet_manager.cc:1428] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:11:07.655740 23734 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.677820 23734 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.678717 23734 tablet_bootstrap.cc:492] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.679543 23734 ts_tablet_manager.cc:1397] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.024s user 0.015s sys 0.004s
I20250109 21:11:07.681880 23734 raft_consensus.cc:357] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.682566 23734 raft_consensus.cc:738] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.683251 23734 consensus_queue.cc:260] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.685369 23734 ts_tablet_manager.cc:1428] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:11:07.686235 23734 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.705554 23837 raft_consensus.cc:3054] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:07.793388 23734 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.794404 23734 tablet_bootstrap.cc:492] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.795114 23734 ts_tablet_manager.cc:1397] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.109s user 0.069s sys 0.028s
I20250109 21:11:07.797864 23734 raft_consensus.cc:357] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:07.798439 23734 raft_consensus.cc:738] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.799878 23734 consensus_queue.cc:260] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:07.801891 23734 ts_tablet_manager.cc:1428] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.003s sys 0.000s
I20250109 21:11:07.803138 23734 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.888715 23734 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.889609 23734 tablet_bootstrap.cc:492] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.890291 23734 ts_tablet_manager.cc:1397] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.087s user 0.045s sys 0.030s
I20250109 21:11:07.892645 23734 raft_consensus.cc:357] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:07.893364 23734 raft_consensus.cc:738] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.894146 23734 consensus_queue.cc:260] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:07.903337 23734 ts_tablet_manager.cc:1428] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.013s user 0.008s sys 0.000s
I20250109 21:11:07.904109 23734 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.935446 23734 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.936324 23734 tablet_bootstrap.cc:492] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.936955 23734 ts_tablet_manager.cc:1397] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.033s user 0.022s sys 0.005s
I20250109 21:11:07.939394 23734 raft_consensus.cc:357] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.940125 23734 raft_consensus.cc:738] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.940815 23734 consensus_queue.cc:260] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:07.943379 23734 ts_tablet_manager.cc:1428] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.008s sys 0.000s
I20250109 21:11:07.945057 23734 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.970814 23734 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.971817 23734 tablet_bootstrap.cc:492] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:07.972513 23734 ts_tablet_manager.cc:1397] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.028s user 0.013s sys 0.007s
I20250109 21:11:07.974767 23734 raft_consensus.cc:357] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:07.975451 23734 raft_consensus.cc:738] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:07.976081 23734 consensus_queue.cc:260] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:07.978241 23734 ts_tablet_manager.cc:1428] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250109 21:11:07.978991 23734 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:07.999030 23734 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:07.999887 23734 tablet_bootstrap.cc:492] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.000514 23734 ts_tablet_manager.cc:1397] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.008s
I20250109 21:11:08.003031 23734 raft_consensus.cc:357] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.003772 23734 raft_consensus.cc:738] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.004406 23734 consensus_queue.cc:260] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.006955 23734 ts_tablet_manager.cc:1428] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.004s sys 0.004s
I20250109 21:11:08.008584 23836 raft_consensus.cc:3054] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:08.013358 23734 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.045547 23734 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.046386 23734 tablet_bootstrap.cc:492] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.047008 23734 ts_tablet_manager.cc:1397] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.034s user 0.015s sys 0.012s
I20250109 21:11:08.048713 23734 raft_consensus.cc:357] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.049185 23734 raft_consensus.cc:738] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.049664 23734 consensus_queue.cc:260] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.051331 23734 ts_tablet_manager.cc:1428] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250109 21:11:08.052071 23734 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.070291 23734 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.071100 23734 tablet_bootstrap.cc:492] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.071672 23734 ts_tablet_manager.cc:1397] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.020s user 0.008s sys 0.010s
I20250109 21:11:08.073724 23734 raft_consensus.cc:357] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:08.074493 23734 raft_consensus.cc:738] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.075181 23734 consensus_queue.cc:260] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:08.076936 23734 ts_tablet_manager.cc:1428] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.005s user 0.003s sys 0.001s
I20250109 21:11:08.077525 23734 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.241461 23835 raft_consensus.cc:3054] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:08.373210 23734 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.374133 23734 tablet_bootstrap.cc:492] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.374756 23734 ts_tablet_manager.cc:1397] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.297s user 0.106s sys 0.159s
I20250109 21:11:08.377087 23734 raft_consensus.cc:357] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.377779 23734 raft_consensus.cc:738] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.378300 23734 consensus_queue.cc:260] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.380012 23734 ts_tablet_manager.cc:1428] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250109 21:11:08.380668 23734 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.395252 23734 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.395911 23734 tablet_bootstrap.cc:492] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.396466 23734 ts_tablet_manager.cc:1397] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.016s user 0.009s sys 0.003s
I20250109 21:11:08.399570 23734 raft_consensus.cc:357] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:08.400180 23734 raft_consensus.cc:738] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.400763 23734 consensus_queue.cc:260] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:08.404554 23734 ts_tablet_manager.cc:1428] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.008s user 0.005s sys 0.000s
I20250109 21:11:08.405241 23734 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.417621 23734 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.418439 23734 tablet_bootstrap.cc:492] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.419075 23734 ts_tablet_manager.cc:1397] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.014s user 0.013s sys 0.000s
I20250109 21:11:08.421200 23734 raft_consensus.cc:357] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
W20250109 21:11:08.421483 22976 consensus_peers.cc:487] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Error code: TABLET_NOT_RUNNING (12). Status: Illegal state: Tablet not RUNNING: INITIALIZED. This is attempt 6: this message will repeat every 5th retry.
I20250109 21:11:08.421700 23734 raft_consensus.cc:738] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.422318 23734 consensus_queue.cc:260] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:08.424232 23734 ts_tablet_manager.cc:1428] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.005s user 0.004s sys 0.000s
I20250109 21:11:08.425648 23734 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.442202 23734 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.442790 23734 tablet_bootstrap.cc:492] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.443328 23734 ts_tablet_manager.cc:1397] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.002s
I20250109 21:11:08.444808 23734 raft_consensus.cc:357] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:08.445211 23734 raft_consensus.cc:738] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.445667 23734 consensus_queue.cc:260] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:08.447475 23734 ts_tablet_manager.cc:1428] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250109 21:11:08.451404 23734 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.489781 23734 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.490432 23734 tablet_bootstrap.cc:492] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.490875 23734 ts_tablet_manager.cc:1397] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.040s user 0.022s sys 0.011s
I20250109 21:11:08.492492 23734 raft_consensus.cc:357] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.492974 23734 raft_consensus.cc:738] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.493530 23734 consensus_queue.cc:260] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.495169 23734 ts_tablet_manager.cc:1428] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.004s user 0.004s sys 0.000s
I20250109 21:11:08.495762 23734 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.509065 23734 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.509968 23734 tablet_bootstrap.cc:492] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.511698 23734 ts_tablet_manager.cc:1397] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.016s user 0.013s sys 0.000s
I20250109 21:11:08.513873 23734 raft_consensus.cc:357] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:08.514591 23734 raft_consensus.cc:738] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.515304 23734 consensus_queue.cc:260] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:08.517699 23734 ts_tablet_manager.cc:1428] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:11:08.518488 23734 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.541455 23734 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.542340 23734 tablet_bootstrap.cc:492] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.543048 23734 ts_tablet_manager.cc:1397] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.025s user 0.013s sys 0.004s
I20250109 21:11:08.547320 23734 raft_consensus.cc:357] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.547994 23734 raft_consensus.cc:738] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.548674 23734 consensus_queue.cc:260] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:08.550568 23734 ts_tablet_manager.cc:1428] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:11:08.551287 23734 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.574175 23734 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.575054 23734 tablet_bootstrap.cc:492] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.575800 23734 ts_tablet_manager.cc:1397] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.025s user 0.016s sys 0.004s
I20250109 21:11:08.578007 23734 raft_consensus.cc:357] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:08.578488 23734 raft_consensus.cc:738] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.579100 23734 consensus_queue.cc:260] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:08.582136 23734 ts_tablet_manager.cc:1428] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:11:08.582957 23734 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap starting.
I20250109 21:11:08.595956 23734 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap replayed 1/1 log segments. Stats: ops{read=1 overwritten=0 applied=1 ignored=0} inserts{seen=0 ignored=0} mutations{seen=0 ignored=0} orphaned_commits=0. Pending: 0 replicates
I20250109 21:11:08.596570 23734 tablet_bootstrap.cc:492] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Bootstrap complete.
I20250109 21:11:08.597048 23734 ts_tablet_manager.cc:1397] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Time spent bootstrapping tablet: real 0.014s user 0.008s sys 0.003s
I20250109 21:11:08.598812 23734 raft_consensus.cc:357] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:08.599400 23734 raft_consensus.cc:738] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Becoming Follower/Learner. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Initialized, Role: FOLLOWER
I20250109 21:11:08.600181 23835 raft_consensus.cc:3054] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:08.599916 23734 consensus_queue.cc:260] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:08.602397 23734 ts_tablet_manager.cc:1428] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7: Time spent starting tablet: real 0.005s user 0.006s sys 0.000s
I20250109 21:11:08.704375 23835 raft_consensus.cc:3054] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:08.795564 23837 raft_consensus.cc:3054] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:08.898891 23837 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
W20250109 21:11:11.948725 22975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 108128us
W20250109 21:11:11.993139 22975 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:32985, user_credentials={real_user=slave}} blocked reactor thread for 43506.1us
W20250109 21:11:12.878557 23181 debug-util.cc:398] Leaking SignalData structure 0x7b08001c1180 after lost signal to thread 20006
W20250109 21:11:12.879973 23181 debug-util.cc:398] Leaking SignalData structure 0x7b080032b600 after lost signal to thread 22867
W20250109 21:11:12.881472 23181 debug-util.cc:398] Leaking SignalData structure 0x7b0800105b80 after lost signal to thread 23035
W20250109 21:11:12.882787 23181 debug-util.cc:398] Leaking SignalData structure 0x7b08002b02a0 after lost signal to thread 23110
W20250109 21:11:12.884413 23181 debug-util.cc:398] Leaking SignalData structure 0x7b080016d2a0 after lost signal to thread 23184
W20250109 21:11:12.885973 23181 debug-util.cc:398] Leaking SignalData structure 0x7b08000d2ae0 after lost signal to thread 23875
I20250109 21:11:13.318598 23944 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.323335 23944 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.324474 23952 raft_consensus.cc:491] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.326974 23952 raft_consensus.cc:513] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:13.331501 23955 raft_consensus.cc:491] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.346673 23952 leader_election.cc:290] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:13.347843 23952 raft_consensus.cc:491] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.349390 23940 raft_consensus.cc:491] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.349790 23944 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.349924 23940 raft_consensus.cc:513] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.352181 23940 leader_election.cc:290] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:13.345934 23955 raft_consensus.cc:513] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.357508 23955 leader_election.cc:290] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.366219 23959 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.372923 23962 raft_consensus.cc:491] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.384963 23950 raft_consensus.cc:491] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.455395 23950 raft_consensus.cc:513] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.455341 23962 raft_consensus.cc:513] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:13.380506 23963 raft_consensus.cc:491] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.457368 23950 leader_election.cc:290] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.394091 23889 raft_consensus.cc:491] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df8c84b03e6f4a5288bdad949ba2447c)
I20250109 21:11:13.457551 23963 raft_consensus.cc:513] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.458259 23889 raft_consensus.cc:513] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.397145 23842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.409909 23942 raft_consensus.cc:491] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.460073 23942 raft_consensus.cc:513] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.461731 23942 leader_election.cc:290] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.463653 23968 raft_consensus.cc:491] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.464112 23968 raft_consensus.cc:513] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:13.465615 23889 leader_election.cc:290] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.349431 23953 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.415086 23964 raft_consensus.cc:491] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.416041 23941 raft_consensus.cc:491] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df8c84b03e6f4a5288bdad949ba2447c)
I20250109 21:11:13.421165 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.466310 23953 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.466806 23941 raft_consensus.cc:513] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:13.440727 23940 raft_consensus.cc:491] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.467808 23940 raft_consensus.cc:513] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.468564 23953 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.468832 23941 leader_election.cc:290] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:13.469800 23940 leader_election.cc:290] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.348960 23952 raft_consensus.cc:513] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.467093 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.470835 23940 raft_consensus.cc:491] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.471328 23940 raft_consensus.cc:513] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.472048 23952 leader_election.cc:290] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.470827 23941 raft_consensus.cc:491] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df8c84b03e6f4a5288bdad949ba2447c)
I20250109 21:11:13.473062 23939 raft_consensus.cc:491] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.431473 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.473579 23939 raft_consensus.cc:513] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.475260 23940 leader_election.cc:290] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:13.472842 23941 raft_consensus.cc:513] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.367734 23959 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.475553 23942 raft_consensus.cc:491] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df8c84b03e6f4a5288bdad949ba2447c)
I20250109 21:11:13.470165 23763 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.475575 23939 leader_election.cc:290] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.476598 23763 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.476368 23942 raft_consensus.cc:513] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.477111 23941 leader_election.cc:290] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.469401 23969 raft_consensus.cc:491] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.478113 23969 raft_consensus.cc:513] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:13.478713 23942 leader_election.cc:290] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.478790 23763 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:13.469592 23964 raft_consensus.cc:513] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.480515 23969 leader_election.cc:290] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:13.480979 23840 raft_consensus.cc:2463] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 1.
I20250109 21:11:13.481323 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.481493 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb4bf7d44374f9d9d8dffad767ec200" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.483680 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.484156 23959 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.484503 23964 leader_election.cc:290] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.484793 23008 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.506107 23965 raft_consensus.cc:491] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.506282 23964 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.485769 23962 leader_election.cc:290] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:13.486425 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.506733 23965 raft_consensus.cc:513] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.485102 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.487567 23963 leader_election.cc:290] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.488606 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.510182 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.491544 23968 leader_election.cc:290] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
W20250109 21:11:13.493315 23051 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.196:40347, user_credentials={real_user=slave}} blocked reactor thread for 81852us
I20250109 21:11:13.498621 23952 raft_consensus.cc:491] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.511544 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.511726 23952 raft_consensus.cc:513] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.512190 23153 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:13.513629 23952 leader_election.cc:290] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.502928 23763 raft_consensus.cc:491] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.514395 23763 raft_consensus.cc:513] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.504269 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2732f8eccc4e4e6499255672a626b4a2" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.504683 23945 raft_consensus.cc:491] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.516127 23945 raft_consensus.cc:513] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:13.519299 23945 leader_election.cc:290] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.519543 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.504973 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "436eb85c9e1e4c93afaa8e19215808a8" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.510869 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.520412 23952 raft_consensus.cc:491] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.520713 23152 raft_consensus.cc:2463] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 1.
I20250109 21:11:13.519618 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c680a42bcf4d467a9cf94539658db79b" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.521226 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.521122 23952 raft_consensus.cc:513] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.520587 23729 leader_election.cc:304] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:13.523030 23953 raft_consensus.cc:491] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.523465 23729 leader_election.cc:304] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:13.523561 23953 raft_consensus.cc:513] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:13.524749 23962 raft_consensus.cc:2743] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.525319 23962 raft_consensus.cc:2743] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.525496 23953 leader_election.cc:290] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:13.525808 23962 raft_consensus.cc:491] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.526559 23952 leader_election.cc:290] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.526983 23962 raft_consensus.cc:513] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:13.508091 23964 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.530295 23763 leader_election.cc:290] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
W20250109 21:11:13.530339 23032 debug-util.cc:398] Leaking SignalData structure 0x7b0800255880 after lost signal to thread 20006
I20250109 21:11:13.531016 23965 leader_election.cc:290] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.530335 23962 leader_election.cc:290] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
W20250109 21:11:13.531852 23032 debug-util.cc:398] Leaking SignalData structure 0x7b08002a3d20 after lost signal to thread 22867
I20250109 21:11:13.532536 23126 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:13.533026 23756 raft_consensus.cc:491] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.533340 23940 raft_consensus.cc:2798] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:13.533748 23940 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.533540 23756 raft_consensus.cc:513] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.530845 23964 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.534116 23940 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:13.534437 23842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.535356 23756 leader_election.cc:290] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.535861 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
W20250109 21:11:13.533066 23032 debug-util.cc:398] Leaking SignalData structure 0x7b0800286a60 after lost signal to thread 23035
I20250109 21:11:13.537037 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "eb61d520b2e04186b48e156c321b7a87" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
W20250109 21:11:13.537325 23032 debug-util.cc:398] Leaking SignalData structure 0x7b080021bea0 after lost signal to thread 23110
W20250109 21:11:13.538463 23032 debug-util.cc:398] Leaking SignalData structure 0x7b08002fa340 after lost signal to thread 23184
I20250109 21:11:13.538372 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.539604 23964 raft_consensus.cc:491] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 227e48f30ae84db6bff43cc2860219a3)
I20250109 21:11:13.530815 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.540109 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.542248 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
W20250109 21:11:13.543131 23032 debug-util.cc:398] Leaking SignalData structure 0x7b0800252700 after lost signal to thread 23875
I20250109 21:11:13.543675 23081 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "cbb4bf7d44374f9d9d8dffad767ec200" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.545925 23079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f43fbf50f6a242cc91616f51d41df9b2" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.547247 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.548038 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.550104 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f32bf225644269afca55cb6491e09a" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.548619 23078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.548722 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.551679 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e4f32bf225644269afca55cb6491e09a" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.547982 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.553707 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7713f12f4e14c9dbf2c0c02c601fec8" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.556181 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.557086 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.558322 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.560577 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5b7026bf15ee44938af84fc1397872aa" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.558615 23940 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.561388 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.562100 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.561296 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.540089 23964 raft_consensus.cc:513] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:13.562798 23078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.565891 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4309ed0e1fa847329590a19703399802" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.563944 23842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.567273 23964 leader_election.cc:290] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.568221 23941 raft_consensus.cc:491] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader df8c84b03e6f4a5288bdad949ba2447c)
I20250109 21:11:13.568529 23940 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:13.568750 23941 raft_consensus.cc:513] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.569200 23078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.568029 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.570307 23083 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.571259 23051 leader_election.cc:304] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:13.571424 23085 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.571565 23079 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.570674 23941 leader_election.cc:290] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.572160 23970 raft_consensus.cc:2743] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.572669 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.574579 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.575006 23078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.576267 23952 raft_consensus.cc:491] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.576797 23952 raft_consensus.cc:513] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:13.578655 23952 leader_election.cc:290] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:13.579213 23730 leader_election.cc:304] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.580236 23962 raft_consensus.cc:2743] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.581288 23730 leader_election.cc:304] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.581871 23125 leader_election.cc:304] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.582343 23962 raft_consensus.cc:2743] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.582883 23763 raft_consensus.cc:2743] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.583438 23730 leader_election.cc:304] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.583710 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.583978 23125 leader_election.cc:304] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.584764 23962 raft_consensus.cc:2743] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.585073 23940 raft_consensus.cc:2743] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.585331 23125 leader_election.cc:304] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.586011 23730 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.587055 23962 raft_consensus.cc:2743] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.587328 23125 leader_election.cc:304] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.586925 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4309ed0e1fa847329590a19703399802" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.588135 23763 raft_consensus.cc:2743] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.588960 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.590138 23842 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:13.590601 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.590153 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.586870 23940 raft_consensus.cc:2743] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.593873 23078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:13.594374 23049 leader_election.cc:304] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:13.594516 23126 leader_election.cc:304] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.594791 23051 leader_election.cc:304] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:13.595611 23965 raft_consensus.cc:2743] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.595999 23940 raft_consensus.cc:2743] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.595204 23967 raft_consensus.cc:2743] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.597571 23051 leader_election.cc:304] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:13.597815 23049 leader_election.cc:304] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:13.598348 23967 raft_consensus.cc:2743] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.598680 23970 raft_consensus.cc:2743] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.600519 23049 leader_election.cc:304] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:13.601261 23967 raft_consensus.cc:2743] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.601284 23051 leader_election.cc:304] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:13.602900 23970 raft_consensus.cc:2743] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.604261 23051 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:13.601305 22976 leader_election.cc:304] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:13.605741 23953 raft_consensus.cc:2798] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:13.606189 23967 raft_consensus.cc:2743] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:13.606161 23953 raft_consensus.cc:491] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.605681 22976 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:13.607247 23953 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:13.608062 23124 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.608875 23125 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.609054 23940 raft_consensus.cc:2743] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.609582 23763 raft_consensus.cc:2743] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.608897 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:13.611061 23952 raft_consensus.cc:2798] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:13.611371 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.612102 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.611536 23952 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:13.613246 23952 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:13.613431 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e85cb6e4e45a40ed966b3016f17f0b08" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.615504 23840 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4b8f3a239a93458eab441de7a47bf286" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:13.617076 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d34599026c142fb83163497006fbfb5" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.618044 23124 leader_election.cc:304] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3; no voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.619074 23940 raft_consensus.cc:2743] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.621699 23952 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.612097 22975 leader_election.cc:304] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.623865 23954 raft_consensus.cc:2743] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.625011 22975 leader_election.cc:304] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.626552 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.626791 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "414f03400b5e43529a493c039a7b7024" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:13.628804 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:13.626855 23051 leader_election.cc:304] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:13.629972 23964 raft_consensus.cc:2743] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.625869 23952 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.631636 23954 raft_consensus.cc:2743] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.631383 23051 leader_election.cc:304] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:13.633214 23964 raft_consensus.cc:2743] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.633808 22975 leader_election.cc:304] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.634508 23952 raft_consensus.cc:2743] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.635326 22975 leader_election.cc:304] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.636022 23952 raft_consensus.cc:2743] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.636377 22975 leader_election.cc:304] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.637101 23952 raft_consensus.cc:2743] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.638101 22975 leader_election.cc:304] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.638759 23952 raft_consensus.cc:2743] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:13.639133 22975 leader_election.cc:304] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.639817 23952 raft_consensus.cc:2743] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.641870 23953 raft_consensus.cc:513] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.643751 23953 leader_election.cc:290] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:13.644829 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:13.645439 23009 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "414f03400b5e43529a493c039a7b7024" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:13.646718 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:13.647445 23078 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:13.651489 23049 leader_election.cc:304] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:13.653165 23964 raft_consensus.cc:2743] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.654768 22975 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.655539 23953 raft_consensus.cc:2743] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.655951 22975 leader_election.cc:304] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c; no voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:13.657181 23953 raft_consensus.cc:2743] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250109 21:11:13.961565 23003 raft_consensus.cc:1235] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Rejecting Update request from peer e1a492f3cf3a4827bb0045500a3abb83 for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:13.963040 23941 consensus_queue.cc:1046] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:13.965754 23964 raft_consensus.cc:3049] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:13.966140 23964 raft_consensus.cc:738] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:13.966897 23964 consensus_queue.cc:260] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.970376 23964 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:13.989591 23003 raft_consensus.cc:1235] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Rejecting Update request from peer e1a492f3cf3a4827bb0045500a3abb83 for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:13.991254 23970 consensus_queue.cc:1046] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:13.991539 23159 raft_consensus.cc:1235] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Rejecting Update request from peer e1a492f3cf3a4827bb0045500a3abb83 for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:13.992697 23967 raft_consensus.cc:3049] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:13.993115 23967 raft_consensus.cc:738] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:13.993958 23967 consensus_queue.cc:260] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:13.995249 23967 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:14.007711 23967 consensus_queue.cc:1046] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.002s
I20250109 21:11:14.011080 23967 raft_consensus.cc:3049] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:14.011503 23967 raft_consensus.cc:738] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:14.012310 23967 consensus_queue.cc:260] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:14.013833 23967 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:15.367697 23972 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:15.368862 23972 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:15.372953 23835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7" is_pre_election: true
I20250109 21:11:15.373107 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:15.375185 23084 raft_consensus.cc:2463] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 2.
I20250109 21:11:15.376571 23972 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:15.376602 23125 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:15.377733 23972 raft_consensus.cc:2798] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:15.378355 23972 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:15.378866 23972 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:15.388743 23972 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:15.390827 23972 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 3 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075)
I20250109 21:11:15.391695 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:15.392614 23084 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:15.392882 23835 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
I20250109 21:11:15.398677 23084 raft_consensus.cc:2463] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 3.
I20250109 21:11:15.399645 23125 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:15.400346 23972 raft_consensus.cc:2798] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:15.400885 23972 raft_consensus.cc:695] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 3 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:15.401973 23972 consensus_queue.cc:237] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:15.416621 22832 catalog_manager.cc:5526] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 1 to 3, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 3 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:15.438321 23976 raft_consensus.cc:491] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:15.438894 23976 raft_consensus.cc:513] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.441267 23976 leader_election.cc:290] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:15.442061 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:15.442585 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:15.442819 23003 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 2.
I20250109 21:11:15.443496 23152 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 1.
I20250109 21:11:15.444505 23049 leader_election.cc:304] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:15.445569 23976 raft_consensus.cc:2798] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:15.445888 23976 raft_consensus.cc:491] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:15.450580 23976 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:15.454557 23940 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:15.455205 23940 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.458588 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c" is_pre_election: true
I20250109 21:11:15.459417 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:15.459764 23003 raft_consensus.cc:2388] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 2: Already voted for candidate df8c84b03e6f4a5288bdad949ba2447c in this term.
I20250109 21:11:15.460107 23084 raft_consensus.cc:2463] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 2.
I20250109 21:11:15.459040 23940 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:15.452365 23984 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:15.462054 23125 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:15.462126 23984 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:15.464206 23763 raft_consensus.cc:2798] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:15.464543 23763 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Starting leader election (detected failure of leader e1a492f3cf3a4827bb0045500a3abb83)
I20250109 21:11:15.464838 23763 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:15.482014 23984 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:15.483120 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:15.483530 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:15.484222 23084 raft_consensus.cc:2363] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51679b9f547940b6a8311fd6fab340f7 for earlier term 2. Current term is 3.
I20250109 21:11:15.485488 23730 leader_election.cc:400] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Vote denied by peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985) with higher term. Message: Invalid argument: T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51679b9f547940b6a8311fd6fab340f7 for earlier term 2. Current term is 3.
I20250109 21:11:15.485857 23730 leader_election.cc:403] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 pre-election: Cancelling election due to peer responding with higher term
I20250109 21:11:15.486693 23984 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 3
I20250109 21:11:15.489457 23763 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.491235 23763 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:15.493357 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:15.494107 23984 raft_consensus.cc:2743] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Leader pre-election lost for term 2. Reason: Vote denied by peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985) with higher term. Message: Invalid argument: T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 51679b9f547940b6a8311fd6fab340f7 for earlier term 2. Current term is 3.
I20250109 21:11:15.497315 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:15.496716 23976 raft_consensus.cc:513] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.498020 23003 raft_consensus.cc:2388] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Denying vote to candidate 227e48f30ae84db6bff43cc2860219a3 in current term 2: Already voted for candidate df8c84b03e6f4a5288bdad949ba2447c in this term.
I20250109 21:11:15.499749 23976 leader_election.cc:290] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:15.500603 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:15.500928 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:15.501603 23003 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:15.501205 23152 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 3
I20250109 21:11:15.510941 23084 raft_consensus.cc:2463] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 2.
I20250109 21:11:15.512423 23125 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters: df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:15.513293 23152 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 3.
I20250109 21:11:15.513389 23763 raft_consensus.cc:2798] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:15.514022 23763 raft_consensus.cc:695] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:15.514597 23051 leader_election.cc:304] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:15.515380 23763 consensus_queue.cc:237] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.516232 23965 raft_consensus.cc:2798] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:15.516748 23965 raft_consensus.cc:695] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:15.517545 23003 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 3.
I20250109 21:11:15.517663 23965 consensus_queue.cc:237] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.566890 22832 catalog_manager.cc:5526] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 1 to 2, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 2 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:15.573747 22831 catalog_manager.cc:5526] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 1 to 3. New cstate: current_term: 3 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
W20250109 21:11:15.577435 23049 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:39559, user_credentials={real_user=slave}} blocked reactor thread for 52078.2us
I20250109 21:11:15.815783 23989 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:15.816385 23989 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.819337 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83" is_pre_election: true
I20250109 21:11:15.819350 23989 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:15.820009 23084 raft_consensus.cc:2463] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:15.820204 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3" is_pre_election: true
I20250109 21:11:15.821448 22975 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:15.822285 23989 raft_consensus.cc:2798] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:15.822640 23989 raft_consensus.cc:491] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:15.823017 23989 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:15.829732 23989 raft_consensus.cc:513] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.832427 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:15.832695 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b5bdc088c0764e47a32e093893889baf" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 3 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:15.833230 23084 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:15.833911 23989 leader_election.cc:290] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 3 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:15.839977 23084 raft_consensus.cc:2463] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 3.
I20250109 21:11:15.840790 22975 leader_election.cc:304] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters: 227e48f30ae84db6bff43cc2860219a3
I20250109 21:11:15.841470 23989 raft_consensus.cc:2798] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:15.841946 23989 raft_consensus.cc:695] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 3 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:15.842871 23989 consensus_queue.cc:237] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:15.853303 22832 catalog_manager.cc:5526] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 2 to 3, leader changed from 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196) to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 3 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:15.962316 23084 raft_consensus.cc:1270] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Refusing update from remote peer 227e48f30ae84db6bff43cc2860219a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250109 21:11:15.964197 23763 consensus_queue.cc:1035] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:15.964920 23840 raft_consensus.cc:1270] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Refusing update from remote peer 227e48f30ae84db6bff43cc2860219a3: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250109 21:11:15.966488 23763 consensus_queue.cc:1035] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:16.000804 23010 raft_consensus.cc:1235] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 3 LEADER]: Rejecting Update request from peer 227e48f30ae84db6bff43cc2860219a3 for earlier term 2. Current term is 3. Ops: []
I20250109 21:11:16.008494 23763 consensus_queue.cc:1046] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: INVALID_TERM, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:16.009374 23763 consensus_queue.cc:1225] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Peer df8c84b03e6f4a5288bdad949ba2447c log is divergent from this leader: its last log entry 3.2 is not in this leader's log and it has not received anything from this leader yet. Falling back to committed index 1
I20250109 21:11:16.009824 23940 raft_consensus.cc:3049] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:16.010126 23940 raft_consensus.cc:738] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:16.010823 23940 consensus_queue.cc:260] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:16.011929 23940 raft_consensus.cc:3054] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:16.076171 23010 raft_consensus.cc:1270] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250109 21:11:16.077436 23965 consensus_queue.cc:1035] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:16.089174 23152 raft_consensus.cc:1270] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250109 21:11:16.091228 23987 consensus_queue.cc:1035] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:16.408357 23152 raft_consensus.cc:1270] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 2. (term mismatch)
I20250109 21:11:16.408764 23152 pending_rounds.cc:77] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3: Aborting all ops after (but not including) 1
I20250109 21:11:16.409036 23152 pending_rounds.cc:99] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3: Aborting uncommitted NO_OP operation due to leader change: 2.2
I20250109 21:11:16.409315 23152 raft_consensus.cc:2883] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: NO_OP replication failed: Aborted: Op aborted by new leader
I20250109 21:11:16.410511 23975 consensus_queue.cc:1035] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:16.435060 23082 raft_consensus.cc:1270] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 3 index: 2. (index mismatch)
I20250109 21:11:16.440773 24000 consensus_queue.cc:1035] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:17.571758 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:17.614487 23152 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f"
dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:48654
I20250109 21:11:17.615235 23152 raft_consensus.cc:604] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:17.617322 23152 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6"
dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:48654
I20250109 21:11:17.617851 23152 raft_consensus.cc:604] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:17.619974 23152 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3"
dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:48654
I20250109 21:11:17.620380 23152 raft_consensus.cc:604] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:17.632388 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:17.632841 23084 raft_consensus.cc:604] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:17.642735 23010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148"
dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:46158
I20250109 21:11:17.643152 23010 raft_consensus.cc:604] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:17.645284 23152 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f"
dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:48654
I20250109 21:11:17.645782 23152 raft_consensus.cc:604] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 3 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:17.647467 23152 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849"
dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:48654
I20250109 21:11:17.647843 23152 raft_consensus.cc:604] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:17.648584 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 7
I20250109 21:11:17.649691 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:17.650194 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:17.692847 24000 raft_consensus.cc:988] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:17.693373 24001 raft_consensus.cc:1076] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:17.694772 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38940
I20250109 21:11:17.695348 23835 raft_consensus.cc:491] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:17.695703 23835 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:17.700850 23835 raft_consensus.cc:513] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:17.703161 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:17.703754 23159 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:17.703773 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "75760788e49142f3b4fe4024c99a2148" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:17.704468 23010 raft_consensus.cc:3049] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:17.704605 23835 leader_election.cc:290] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 3 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:17.704777 23010 raft_consensus.cc:738] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:17.705574 23010 consensus_queue.cc:260] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:17.706779 23010 raft_consensus.cc:3054] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:17.709663 23159 raft_consensus.cc:2463] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 3.
I20250109 21:11:17.710966 23731 leader_election.cc:304] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:17.713158 23010 raft_consensus.cc:2463] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 3.
I20250109 21:11:17.713464 24008 raft_consensus.cc:2798] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:17.714761 24008 raft_consensus.cc:695] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 3 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:17.715430 24008 consensus_queue.cc:237] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:17.724136 23940 raft_consensus.cc:988] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:17.724504 23763 raft_consensus.cc:1076] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:17.725091 22831 catalog_manager.cc:5526] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 2 to 3, leader changed from df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:17.725775 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38946
I20250109 21:11:17.726274 23835 raft_consensus.cc:491] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:17.726552 23835 raft_consensus.cc:3054] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:17.733299 23835 raft_consensus.cc:513] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:17.734726 23835 leader_election.cc:290] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:17.735388 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:17.735961 23159 raft_consensus.cc:3049] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:17.736056 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "35a60ca37e934a699afc4cea1348eeb6" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:17.736287 23159 raft_consensus.cc:738] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:17.736626 23010 raft_consensus.cc:3054] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:17.736956 23159 consensus_queue.cc:260] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:17.738222 23159 raft_consensus.cc:3054] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:17.743549 23010 raft_consensus.cc:2463] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:17.744781 23159 raft_consensus.cc:2463] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:17.744848 23729 leader_election.cc:304] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:17.745764 24008 raft_consensus.cc:2798] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:17.746212 24008 raft_consensus.cc:695] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:17.747021 24008 consensus_queue.cc:237] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:17.757398 22831 catalog_manager.cc:5526] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:17.820668 23940 raft_consensus.cc:988] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:17.821087 23763 raft_consensus.cc:1076] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:17.822275 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38946
I20250109 21:11:17.822676 23835 raft_consensus.cc:491] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:17.822943 23835 raft_consensus.cc:3054] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:17.829102 23835 raft_consensus.cc:513] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:17.831279 23835 leader_election.cc:290] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:17.831450 23159 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:17.832065 23159 raft_consensus.cc:3049] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:17.832338 23159 raft_consensus.cc:738] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:17.832880 23159 consensus_queue.cc:260] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:17.833727 23159 raft_consensus.cc:3054] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:17.836032 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "fe0ebd1c0ccc476b9d29f49ee9429849" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:17.836601 23084 raft_consensus.cc:3054] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:17.841411 23084 raft_consensus.cc:2463] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:17.844482 23730 leader_election.cc:304] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:17.845995 24008 raft_consensus.cc:2798] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:17.846490 24008 raft_consensus.cc:695] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:17.847330 24008 consensus_queue.cc:237] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:17.850250 23159 raft_consensus.cc:2463] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:17.858414 22831 catalog_manager.cc:5526] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:17.881709 23763 raft_consensus.cc:988] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:17.882148 23940 raft_consensus.cc:1076] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:17.883396 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38946
I20250109 21:11:17.883917 23835 raft_consensus.cc:491] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:17.884266 23835 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:17.889686 23835 raft_consensus.cc:513] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:17.891448 23835 leader_election.cc:290] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 3 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:17.891678 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:17.891947 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "11f80cf1724045a18b8e19fcc3e57c5f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:17.892261 23084 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:17.892499 23152 raft_consensus.cc:3049] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:17.892716 23152 raft_consensus.cc:738] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:17.893179 23152 consensus_queue.cc:260] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:17.893980 23152 raft_consensus.cc:3054] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:17.896520 23084 raft_consensus.cc:2463] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 3.
I20250109 21:11:17.897452 23730 leader_election.cc:304] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:17.898144 24008 raft_consensus.cc:2798] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:17.898665 24008 raft_consensus.cc:695] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 3 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:17.899588 24008 consensus_queue.cc:237] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:17.900323 23152 raft_consensus.cc:2463] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 3.
I20250109 21:11:17.910176 22831 catalog_manager.cc:5526] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 2 to 3, leader changed from 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:18.060292 24019 raft_consensus.cc:988] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.060456 23763 raft_consensus.cc:988] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.060742 23940 raft_consensus.cc:1076] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 3 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.060971 24019 raft_consensus.cc:1076] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.061955 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38946
I20250109 21:11:18.062260 23838 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38946
I20250109 21:11:18.062368 23835 raft_consensus.cc:491] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:18.062719 23835 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:18.062737 23838 raft_consensus.cc:491] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:18.063143 23838 raft_consensus.cc:3054] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:18.069437 23835 raft_consensus.cc:513] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.071031 23835 leader_election.cc:290] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 4 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:18.071985 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:18.072070 23838 raft_consensus.cc:513] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.072427 23152 raft_consensus.cc:3049] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:11:18.072696 23152 raft_consensus.cc:738] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:18.073184 23152 consensus_queue.cc:260] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.074136 23152 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:18.074185 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:18.074800 23082 raft_consensus.cc:3054] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:18.078307 23152 raft_consensus.cc:2463] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 4.
I20250109 21:11:18.079291 23731 leader_election.cc:304] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:18.079668 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "398bc3fa45cb462e85dc87212af53ec3" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:18.079828 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "90cf2809271744d4a4616db6fc05551f" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:18.080241 24008 raft_consensus.cc:2798] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:11:18.080271 23152 raft_consensus.cc:3049] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:18.081018 23152 raft_consensus.cc:738] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:18.081317 23082 raft_consensus.cc:2463] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:18.081583 24008 raft_consensus.cc:695] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 4 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:18.082959 23838 leader_election.cc:290] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:18.082736 23730 leader_election.cc:304] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:18.080413 23084 raft_consensus.cc:3054] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:18.083838 24009 raft_consensus.cc:2798] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:18.085223 24009 raft_consensus.cc:695] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:18.085506 23152 consensus_queue.cc:260] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.086373 23152 raft_consensus.cc:3054] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:18.086001 24009 consensus_queue.cc:237] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.082753 24008 consensus_queue.cc:237] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.092166 23084 raft_consensus.cc:2463] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 4.
I20250109 21:11:18.096709 23152 raft_consensus.cc:2463] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:18.100965 22831 catalog_manager.cc:5526] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 3 to 4, leader changed from 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 4 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:18.116096 22831 catalog_manager.cc:5526] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:18.159549 24016 raft_consensus.cc:988] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.160157 24023 raft_consensus.cc:1076] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.161896 23838 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38960
I20250109 21:11:18.162355 23838 raft_consensus.cc:491] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:18.162643 23838 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:18.168185 23838 raft_consensus.cc:513] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:18.169564 23838 leader_election.cc:290] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 3 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:18.170228 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:18.170264 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "599de49040a74fba9b64f8f5cd31e376" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:18.170694 23010 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:18.170888 23084 raft_consensus.cc:3049] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:18.171408 23084 raft_consensus.cc:738] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:18.172026 23084 consensus_queue.cc:260] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:18.172855 23084 raft_consensus.cc:3054] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:18.175045 23010 raft_consensus.cc:2463] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 3.
I20250109 21:11:18.175882 23729 leader_election.cc:304] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:18.176558 24008 raft_consensus.cc:2798] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:18.176913 24008 raft_consensus.cc:695] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 3 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:18.177492 23084 raft_consensus.cc:2463] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 3.
I20250109 21:11:18.177618 24008 consensus_queue.cc:237] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:18.186259 22831 catalog_manager.cc:5526] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 2 to 3, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 3 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:18.239149 23152 raft_consensus.cc:1270] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:18.240216 24008 consensus_queue.cc:1035] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:18.254390 23010 raft_consensus.cc:1270] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:18.258399 24020 consensus_queue.cc:1035] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:18.293839 23010 raft_consensus.cc:1270] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:18.294778 24008 consensus_queue.cc:1035] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:18.303206 23152 raft_consensus.cc:1270] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:18.304982 24009 consensus_queue.cc:1035] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:18.381865 23084 raft_consensus.cc:1270] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:18.383213 24020 consensus_queue.cc:1035] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:18.384619 23152 raft_consensus.cc:1270] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:18.385946 24020 consensus_queue.cc:1035] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:18.402737 23152 raft_consensus.cc:1270] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:18.404079 24009 consensus_queue.cc:1035] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:18.416508 23078 raft_consensus.cc:1270] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:18.417974 24008 consensus_queue.cc:1035] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:18.475313 23152 raft_consensus.cc:1270] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20250109 21:11:18.476294 24020 consensus_queue.cc:1035] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:18.484988 23078 raft_consensus.cc:1270] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20250109 21:11:18.486405 24008 consensus_queue.cc:1035] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:18.562398 23078 raft_consensus.cc:1270] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:18.563645 24008 consensus_queue.cc:1035] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:18.566433 23152 raft_consensus.cc:1270] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:18.567606 24027 consensus_queue.cc:1035] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:18.682274 23084 raft_consensus.cc:1270] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:18.683256 24008 consensus_queue.cc:1035] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:18.686383 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:18.691592 23003 raft_consensus.cc:1270] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:18.694101 24027 consensus_queue.cc:1035] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:18.757542 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:18.758005 23084 raft_consensus.cc:604] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Received request to transfer leadership to TS df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:18.760120 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "227e48f30ae84db6bff43cc2860219a3"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:18.760658 23084 raft_consensus.cc:604] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Received request to transfer leadership to TS 227e48f30ae84db6bff43cc2860219a3
I20250109 21:11:18.763092 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:18.763664 23084 raft_consensus.cc:604] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:18.765822 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:18.766196 23084 raft_consensus.cc:604] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:18.767975 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:18.768347 23084 raft_consensus.cc:604] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:18.769170 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 5
I20250109 21:11:18.770498 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:18.770979 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:18.781376 24016 raft_consensus.cc:988] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.781836 24016 raft_consensus.cc:1076] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.783636 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38960
I20250109 21:11:18.784108 23835 raft_consensus.cc:491] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:18.784443 23835 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:18.790890 23835 raft_consensus.cc:513] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.792546 23835 leader_election.cc:290] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 4 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:18.793449 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:18.793669 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f77b5e306c7d4f8884ceab7a4fd81b55" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:18.794126 23153 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:18.794224 23084 raft_consensus.cc:3049] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:11:18.794620 23084 raft_consensus.cc:738] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:18.795351 23084 consensus_queue.cc:260] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.796538 23084 raft_consensus.cc:3054] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:18.803109 23084 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 4.
I20250109 21:11:18.805166 23730 leader_election.cc:304] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:18.800812 23153 raft_consensus.cc:2463] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 4.
I20250109 21:11:18.807876 24008 raft_consensus.cc:2798] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:11:18.808367 24008 raft_consensus.cc:695] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 4 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:18.809197 24008 consensus_queue.cc:237] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:18.819295 22829 catalog_manager.cc:5526] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 3 to 4, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 4 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:18.857786 24016 raft_consensus.cc:988] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.858263 24016 raft_consensus.cc:1076] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.860567 23838 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38960
I20250109 21:11:18.861023 23838 raft_consensus.cc:491] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:18.861315 23838 raft_consensus.cc:3054] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:18.867244 23838 raft_consensus.cc:513] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:18.869741 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:18.870276 23010 raft_consensus.cc:3054] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:18.870393 23838 leader_election.cc:290] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:18.872385 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ed33dab38b804fefb73e51dca12d3867" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:18.872886 23084 raft_consensus.cc:3049] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:18.873181 23084 raft_consensus.cc:738] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:18.873895 23084 consensus_queue.cc:260] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:18.875100 23084 raft_consensus.cc:3054] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:18.876507 23010 raft_consensus.cc:2463] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:18.877583 23729 leader_election.cc:304] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:18.878366 24008 raft_consensus.cc:2798] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:18.878819 24008 raft_consensus.cc:695] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:18.879634 24008 consensus_queue.cc:237] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:18.880816 23084 raft_consensus.cc:2463] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:18.895459 22829 catalog_manager.cc:5526] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:18.992170 24048 raft_consensus.cc:988] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.992637 24016 raft_consensus.cc:1076] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:18.994024 23838 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38960
I20250109 21:11:18.994683 23838 raft_consensus.cc:491] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:18.995107 23838 raft_consensus.cc:3054] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.004017 23838 raft_consensus.cc:513] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:19.007493 23838 leader_election.cc:290] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:19.008481 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:19.010000 23010 raft_consensus.cc:3054] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.010789 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e6afbf946f284e519b91063ad62d781a" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:19.011381 23084 raft_consensus.cc:3049] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:19.011648 23084 raft_consensus.cc:738] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:19.012888 23084 consensus_queue.cc:260] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:19.016392 23084 raft_consensus.cc:3054] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.019594 23010 raft_consensus.cc:2463] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:19.020702 23729 leader_election.cc:304] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:19.021477 24027 raft_consensus.cc:2798] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:19.021816 24027 raft_consensus.cc:695] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:19.022707 23084 raft_consensus.cc:2463] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:19.022495 24027 consensus_queue.cc:237] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:19.031222 22829 catalog_manager.cc:5526] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:19.035400 24016 raft_consensus.cc:988] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower df8c84b03e6f4a5288bdad949ba2447c to start an election
I20250109 21:11:19.036865 24048 raft_consensus.cc:1076] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Signalling peer df8c84b03e6f4a5288bdad949ba2447c to start an election
I20250109 21:11:19.038239 23010 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f"
dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
from {username='slave'} at 127.0.0.1:50976
I20250109 21:11:19.038729 23010 raft_consensus.cc:491] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:19.039068 23010 raft_consensus.cc:3054] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.043906 23010 raft_consensus.cc:513] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:19.045222 23010 leader_election.cc:290] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:19.045789 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:19.046022 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "19866aa90bdd4d5e91b1ac29ae31743f" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:19.046392 23084 raft_consensus.cc:3049] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:19.046563 23153 raft_consensus.cc:3054] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.046748 23084 raft_consensus.cc:738] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:19.047546 23084 consensus_queue.cc:260] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:19.048767 23084 raft_consensus.cc:3054] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.053022 23153 raft_consensus.cc:2463] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:19.054177 22976 leader_election.cc:304] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:19.054973 24052 raft_consensus.cc:2798] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:19.055223 23084 raft_consensus.cc:2463] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:19.055439 24052 raft_consensus.cc:695] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:19.056315 24052 consensus_queue.cc:237] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:19.066548 22829 catalog_manager.cc:5526] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 1 to 2, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 2 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:19.196684 24016 raft_consensus.cc:988] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower 227e48f30ae84db6bff43cc2860219a3 to start an election
I20250109 21:11:19.197245 23987 raft_consensus.cc:1076] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Signalling peer 227e48f30ae84db6bff43cc2860219a3 to start an election
I20250109 21:11:19.198493 23153 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3"
dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
from {username='slave'} at 127.0.0.1:35726
I20250109 21:11:19.199072 23153 raft_consensus.cc:491] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:19.199381 23153 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:19.204243 23153 raft_consensus.cc:513] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:19.205835 23153 leader_election.cc:290] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 4 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:19.206441 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:19.206691 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4c150b5bc7644fcb865799e65af066f3" candidate_uuid: "227e48f30ae84db6bff43cc2860219a3" candidate_term: 4 candidate_status { last_received { term: 3 index: 2 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:19.207067 23010 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:19.207217 23084 raft_consensus.cc:3049] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Stepping down as leader of term 3
I20250109 21:11:19.207573 23084 raft_consensus.cc:738] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:19.208215 23084 consensus_queue.cc:260] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 3, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:19.209347 23084 raft_consensus.cc:3054] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Advancing to term 4
I20250109 21:11:19.213032 23010 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 4.
I20250109 21:11:19.214038 23124 leader_election.cc:304] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [CANDIDATE]: Term 4 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:19.214745 24051 raft_consensus.cc:2798] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Leader election won for term 4
I20250109 21:11:19.215180 24051 raft_consensus.cc:695] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 4 LEADER]: Becoming Leader. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:19.215276 23084 raft_consensus.cc:2463] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 227e48f30ae84db6bff43cc2860219a3 in term 4.
I20250109 21:11:19.215955 24051 consensus_queue.cc:237] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 3.2, Last appended by leader: 2, Current term: 4, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:19.224017 22829 catalog_manager.cc:5526] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 reported cstate change: term changed from 3 to 4, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196). New cstate: current_term: 4 leader_uuid: "227e48f30ae84db6bff43cc2860219a3" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:19.366227 23084 raft_consensus.cc:1270] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20250109 21:11:19.367321 24020 consensus_queue.cc:1035] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:19.377816 23153 raft_consensus.cc:1270] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20250109 21:11:19.380596 24027 consensus_queue.cc:1035] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:19.426381 23084 raft_consensus.cc:1270] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:19.427768 24027 consensus_queue.cc:1035] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:19.439514 23084 raft_consensus.cc:1270] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:19.440358 23010 raft_consensus.cc:1270] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:19.440809 24052 consensus_queue.cc:1035] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:19.441814 24008 consensus_queue.cc:1035] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:19.452606 23084 raft_consensus.cc:1270] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:19.469813 24027 consensus_queue.cc:1035] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:19.478084 23003 raft_consensus.cc:1270] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:19.480412 24008 consensus_queue.cc:1035] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.001s
I20250109 21:11:19.542161 23153 raft_consensus.cc:1270] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:19.548204 24073 consensus_queue.cc:1035] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:19.610383 23003 raft_consensus.cc:1270] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 4 FOLLOWER]: Refusing update from remote peer 227e48f30ae84db6bff43cc2860219a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20250109 21:11:19.611444 24070 consensus_queue.cc:1035] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:19.618506 23078 raft_consensus.cc:1270] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Refusing update from remote peer 227e48f30ae84db6bff43cc2860219a3: Log matching property violated. Preceding OpId in replica: term: 3 index: 2. Preceding OpId from leader: term: 4 index: 3. (index mismatch)
I20250109 21:11:19.619951 24019 consensus_queue.cc:1035] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:19.813542 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:19.843178 23010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "39ae691cd7d54ac7b9e143a80bff4799"
dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:46158
I20250109 21:11:19.843775 23010 raft_consensus.cc:604] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:19.845718 23152 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e"
dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
mode: GRACEFUL
new_leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
from {username='slave'} at 127.0.0.1:48654
I20250109 21:11:19.846083 23152 raft_consensus.cc:604] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Received request to transfer leadership to TS df8c84b03e6f4a5288bdad949ba2447c
I20250109 21:11:19.847913 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "58e256470c0347368a2757ad2e66e833"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:19.848423 23084 raft_consensus.cc:604] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:19.851161 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:19.851637 23084 raft_consensus.cc:604] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:19.852509 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 4
I20250109 21:11:19.853865 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:19.854254 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:19.865250 24051 raft_consensus.cc:988] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3: : Instructing follower df8c84b03e6f4a5288bdad949ba2447c to start an election
I20250109 21:11:19.865693 24070 raft_consensus.cc:1076] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Signalling peer df8c84b03e6f4a5288bdad949ba2447c to start an election
I20250109 21:11:19.867120 23010 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e"
dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
from {username='slave'} at 127.0.0.1:50982
I20250109 21:11:19.867550 23010 raft_consensus.cc:491] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:19.867798 23010 raft_consensus.cc:3054] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.874204 23010 raft_consensus.cc:513] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:19.875497 23010 leader_election.cc:290] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:19.876147 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:19.876408 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3fde04e5e5c34372a88503ab457cda0e" candidate_uuid: "df8c84b03e6f4a5288bdad949ba2447c" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:19.876775 23152 raft_consensus.cc:3049] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:19.876928 23082 raft_consensus.cc:3054] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.877092 23152 raft_consensus.cc:738] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 227e48f30ae84db6bff43cc2860219a3, State: Running, Role: LEADER
I20250109 21:11:19.877708 23152 consensus_queue.cc:260] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:19.878621 23152 raft_consensus.cc:3054] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:19.881487 23082 raft_consensus.cc:2463] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:19.882563 22975 leader_election.cc:304] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: df8c84b03e6f4a5288bdad949ba2447c, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:19.884352 24072 raft_consensus.cc:2798] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:19.884821 24072 raft_consensus.cc:695] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Becoming Leader. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:19.885679 23152 raft_consensus.cc:2463] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate df8c84b03e6f4a5288bdad949ba2447c in term 2.
I20250109 21:11:19.885527 24072 consensus_queue.cc:237] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:19.897507 22829 catalog_manager.cc:5526] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c reported cstate change: term changed from 1 to 2, leader changed from 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196) to df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194). New cstate: current_term: 2 leader_uuid: "df8c84b03e6f4a5288bdad949ba2447c" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:20.011780 23987 raft_consensus.cc:988] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:20.012195 24048 raft_consensus.cc:1076] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:20.013370 23838 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38960
I20250109 21:11:20.013847 23838 raft_consensus.cc:491] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:20.014117 23838 raft_consensus.cc:3054] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.019942 23838 raft_consensus.cc:513] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:20.021448 23838 leader_election.cc:290] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:20.022081 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:20.022310 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d63c66a4270c48cbb4a02ccefda3d871" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:20.022740 23082 raft_consensus.cc:3049] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:20.022840 23152 raft_consensus.cc:3054] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.023059 23082 raft_consensus.cc:738] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:20.023816 23082 consensus_queue.cc:260] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:20.024914 23082 raft_consensus.cc:3054] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.027400 23152 raft_consensus.cc:2463] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:20.028196 23731 leader_election.cc:304] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:20.028832 24027 raft_consensus.cc:2798] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:20.029361 24027 raft_consensus.cc:695] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:20.030566 23082 raft_consensus.cc:2463] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:20.030216 24027 consensus_queue.cc:237] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:20.039984 22833 catalog_manager.cc:5526] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:20.238853 24073 raft_consensus.cc:988] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:20.239328 24072 raft_consensus.cc:1076] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:20.240464 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "39ae691cd7d54ac7b9e143a80bff4799"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38940
I20250109 21:11:20.240852 23835 raft_consensus.cc:491] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:20.241068 23835 raft_consensus.cc:3054] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.245481 23835 raft_consensus.cc:513] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:20.246796 23835 leader_election.cc:290] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347), df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559)
I20250109 21:11:20.247442 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39ae691cd7d54ac7b9e143a80bff4799" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:20.247799 23003 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39ae691cd7d54ac7b9e143a80bff4799" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:20.248083 23152 raft_consensus.cc:3054] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.248430 23003 raft_consensus.cc:3049] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:20.248734 23003 raft_consensus.cc:738] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:20.249459 23003 consensus_queue.cc:260] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:20.250723 23003 raft_consensus.cc:3054] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.254324 23152 raft_consensus.cc:2463] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:20.255343 23731 leader_election.cc:304] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:20.256062 24027 raft_consensus.cc:2798] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:20.256454 24027 raft_consensus.cc:695] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:20.257599 23003 raft_consensus.cc:2463] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:20.257264 24027 consensus_queue.cc:237] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } }
I20250109 21:11:20.267164 22833 catalog_manager.cc:5526] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:20.331264 23152 raft_consensus.cc:1270] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:20.332300 24073 consensus_queue.cc:1035] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:20.342504 23082 raft_consensus.cc:1270] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer df8c84b03e6f4a5288bdad949ba2447c: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:20.343735 24072 consensus_queue.cc:1035] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:20.354943 24048 raft_consensus.cc:988] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:20.355378 24048 raft_consensus.cc:1076] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:20.357347 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "58e256470c0347368a2757ad2e66e833"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38960
I20250109 21:11:20.357780 23835 raft_consensus.cc:491] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:20.358094 23835 raft_consensus.cc:3054] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.367285 23835 raft_consensus.cc:513] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:20.369319 23835 leader_election.cc:290] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985)
I20250109 21:11:20.369591 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:20.370198 23010 raft_consensus.cc:3054] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.370976 23082 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "58e256470c0347368a2757ad2e66e833" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:20.371624 23082 raft_consensus.cc:3049] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:20.373525 23082 raft_consensus.cc:738] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:20.374267 23082 consensus_queue.cc:260] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:20.375152 23010 raft_consensus.cc:2463] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:20.375241 23082 raft_consensus.cc:3054] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:20.376102 23729 leader_election.cc:304] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 51679b9f547940b6a8311fd6fab340f7, df8c84b03e6f4a5288bdad949ba2447c; no voters:
I20250109 21:11:20.376767 24027 raft_consensus.cc:2798] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:20.377140 24027 raft_consensus.cc:695] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:20.377832 24027 consensus_queue.cc:237] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } }
I20250109 21:11:20.380986 23082 raft_consensus.cc:2463] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:20.387863 22833 catalog_manager.cc:5526] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:20.558861 23082 raft_consensus.cc:1270] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:20.560014 24027 consensus_queue.cc:1035] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:20.578598 23152 raft_consensus.cc:1270] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:20.580127 24027 consensus_queue.cc:1035] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:20.681517 23010 raft_consensus.cc:1270] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:20.682592 24027 consensus_queue.cc:1035] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:20.697126 23152 raft_consensus.cc:1270] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:20.698256 24027 consensus_queue.cc:1035] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:20.777261 23010 raft_consensus.cc:1270] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:20.778218 24027 consensus_queue.cc:1035] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:20.786517 23084 raft_consensus.cc:1270] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:20.788996 24094 consensus_queue.cc:1035] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:20.893846 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:20.932022 23010 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5"
dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
mode: GRACEFUL
new_leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
from {username='slave'} at 127.0.0.1:46158
I20250109 21:11:20.932490 23010 raft_consensus.cc:604] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Received request to transfer leadership to TS e1a492f3cf3a4827bb0045500a3abb83
I20250109 21:11:20.933363 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250109 21:11:20.934396 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:20.934827 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:21.370538 24096 raft_consensus.cc:988] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c: : Instructing follower e1a492f3cf3a4827bb0045500a3abb83 to start an election
I20250109 21:11:21.371218 24096 raft_consensus.cc:1076] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Signalling peer e1a492f3cf3a4827bb0045500a3abb83 to start an election
I20250109 21:11:21.372936 23082 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
from {username='slave'} at 127.0.0.1:41356
I20250109 21:11:21.373456 23082 raft_consensus.cc:491] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:21.373782 23082 raft_consensus.cc:3054] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:21.379410 23082 raft_consensus.cc:513] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:21.380807 23082 leader_election.cc:290] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Requested vote from peers df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:21.381605 23010 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "df8c84b03e6f4a5288bdad949ba2447c"
I20250109 21:11:21.381680 23153 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1700a41cd4c54a0d8b7e2e23d22f18a5" candidate_uuid: "e1a492f3cf3a4827bb0045500a3abb83" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:21.382282 23010 raft_consensus.cc:3049] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:21.382321 23153 raft_consensus.cc:3054] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:21.382560 23010 raft_consensus.cc:738] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Becoming Follower/Learner. State: Replica: df8c84b03e6f4a5288bdad949ba2447c, State: Running, Role: LEADER
I20250109 21:11:21.383229 23010 consensus_queue.cc:260] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:21.384130 23010 raft_consensus.cc:3054] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:21.387274 23153 raft_consensus.cc:2463] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 2.
I20250109 21:11:21.388324 23051 leader_election.cc:304] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, e1a492f3cf3a4827bb0045500a3abb83; no voters:
I20250109 21:11:21.388830 23010 raft_consensus.cc:2463] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate e1a492f3cf3a4827bb0045500a3abb83 in term 2.
I20250109 21:11:21.389117 23987 raft_consensus.cc:2798] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:21.389592 23987 raft_consensus.cc:695] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Becoming Leader. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:21.390173 23987 consensus_queue.cc:237] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } }
I20250109 21:11:21.399415 22829 catalog_manager.cc:5526] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 reported cstate change: term changed from 1 to 2, leader changed from df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194) to e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "e1a492f3cf3a4827bb0045500a3abb83" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:21.797083 23152 raft_consensus.cc:1270] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:21.798130 24048 consensus_queue.cc:1035] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:21.808851 23003 raft_consensus.cc:1270] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Refusing update from remote peer e1a492f3cf3a4827bb0045500a3abb83: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:21.810396 23987 consensus_queue.cc:1035] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [LEADER]: Connected to new peer: Peer: permanent_uuid: "df8c84b03e6f4a5288bdad949ba2447c" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 39559 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:21.964707 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:21.997714 23084 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981"
dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
mode: GRACEFUL
new_leader_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:60690
I20250109 21:11:21.998165 23084 raft_consensus.cc:604] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Received request to transfer leadership to TS 51679b9f547940b6a8311fd6fab340f7
I20250109 21:11:21.999167 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 1
I20250109 21:11:22.000157 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:22.000628 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:22.410651 23987 raft_consensus.cc:988] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83: : Instructing follower 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:22.411123 24048 raft_consensus.cc:1076] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Signalling peer 51679b9f547940b6a8311fd6fab340f7 to start an election
I20250109 21:11:22.412494 23835 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981"
dest_uuid: "51679b9f547940b6a8311fd6fab340f7"
from {username='slave'} at 127.0.0.1:38960
I20250109 21:11:22.413050 23835 raft_consensus.cc:491] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:22.413369 23835 raft_consensus.cc:3054] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:22.419689 23835 raft_consensus.cc:513] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:22.422015 23835 leader_election.cc:290] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Requested vote from peers e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985), 227e48f30ae84db6bff43cc2860219a3 (127.19.136.196:40347)
I20250109 21:11:22.422226 23084 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "e1a492f3cf3a4827bb0045500a3abb83"
I20250109 21:11:22.422508 23152 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7ea2612c1c6e4ee6b27cc5626e5fc981" candidate_uuid: "51679b9f547940b6a8311fd6fab340f7" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "227e48f30ae84db6bff43cc2860219a3"
I20250109 21:11:22.422876 23084 raft_consensus.cc:3049] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:22.423044 23152 raft_consensus.cc:3054] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:22.423208 23084 raft_consensus.cc:738] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: e1a492f3cf3a4827bb0045500a3abb83, State: Running, Role: LEADER
I20250109 21:11:22.423982 23084 consensus_queue.cc:260] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:22.425119 23084 raft_consensus.cc:3054] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:22.429234 23152 raft_consensus.cc:2463] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:22.430356 23731 leader_election.cc:304] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 227e48f30ae84db6bff43cc2860219a3, 51679b9f547940b6a8311fd6fab340f7; no voters:
I20250109 21:11:22.431108 24111 raft_consensus.cc:2798] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:22.431578 24111 raft_consensus.cc:695] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Becoming Leader. State: Replica: 51679b9f547940b6a8311fd6fab340f7, State: Running, Role: LEADER
I20250109 21:11:22.431536 23084 raft_consensus.cc:2463] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 51679b9f547940b6a8311fd6fab340f7 in term 2.
I20250109 21:11:22.432379 24111 consensus_queue.cc:237] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } }
I20250109 21:11:22.442751 22829 catalog_manager.cc:5526] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 reported cstate change: term changed from 1 to 2, leader changed from e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195) to 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "51679b9f547940b6a8311fd6fab340f7" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "51679b9f547940b6a8311fd6fab340f7" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 44075 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:22.856709 23082 raft_consensus.cc:1270] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:22.857864 24111 consensus_queue.cc:1035] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "e1a492f3cf3a4827bb0045500a3abb83" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 32985 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:22.869035 23153 raft_consensus.cc:1270] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Refusing update from remote peer 51679b9f547940b6a8311fd6fab340f7: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:22.871636 24118 consensus_queue.cc:1035] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [LEADER]: Connected to new peer: Peer: permanent_uuid: "227e48f30ae84db6bff43cc2860219a3" member_type: VOTER last_known_addr { host: "127.19.136.196" port: 40347 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:23.036168 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:23.068441 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:23.069461 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:23.069859 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:23.108580 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:23.141568 20003 tablet_server.cc:178] TabletServer@127.19.136.193:44075 shutting down...
W20250109 21:11:23.143275 23126 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 258 similar messages]
W20250109 21:11:23.146461 23126 consensus_peers.cc:487] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.171315 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:11:23.174252 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.175251 20003 raft_consensus.cc:2238] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.176198 20003 raft_consensus.cc:2267] T 75760788e49142f3b4fe4024c99a2148 P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.178321 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.178866 20003 raft_consensus.cc:2238] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.179303 20003 raft_consensus.cc:2267] T 1df676409e0c4c1ca1dc047d238e4a14 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.181219 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.181751 20003 raft_consensus.cc:2238] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.182382 20003 raft_consensus.cc:2267] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.184549 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.185072 20003 raft_consensus.cc:2238] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.185405 20003 raft_consensus.cc:2267] T c762018d1be74ce190b41ebd28a2e93e P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.187156 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.187868 20003 raft_consensus.cc:2238] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.188360 20003 raft_consensus.cc:2267] T 125b38b701634accb2448016a89bc27f P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.190896 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.191478 20003 raft_consensus.cc:2238] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.191844 20003 raft_consensus.cc:2267] T 575f5547ec354edc8ac999aec2222318 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.193776 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.194537 20003 raft_consensus.cc:2238] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.195021 20003 raft_consensus.cc:2267] T e27c19622df5416eb965291aeb863154 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.196861 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.197362 20003 raft_consensus.cc:2238] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.197686 20003 raft_consensus.cc:2267] T fcdcdd56a86d4793892b6a99883be239 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.199812 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.200363 20003 raft_consensus.cc:2238] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.200791 20003 raft_consensus.cc:2267] T 2732f8eccc4e4e6499255672a626b4a2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.202944 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.203713 20003 raft_consensus.cc:2238] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.204062 20003 raft_consensus.cc:2267] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.205746 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.206262 20003 raft_consensus.cc:2238] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.206672 20003 raft_consensus.cc:2267] T 4309ed0e1fa847329590a19703399802 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.208367 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.208839 20003 raft_consensus.cc:2238] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.209506 20003 raft_consensus.cc:2267] T fe0ebd1c0ccc476b9d29f49ee9429849 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.211159 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.211639 20003 raft_consensus.cc:2238] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.212263 20003 raft_consensus.cc:2267] T 58e256470c0347368a2757ad2e66e833 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.214355 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.215158 20003 raft_consensus.cc:2238] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.215718 20003 raft_consensus.cc:2267] T be8d475138234afd9334c27a5ef7b9ef P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.217072 23051 consensus_peers.cc:487] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.218142 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.218695 20003 raft_consensus.cc:2238] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.219082 20003 raft_consensus.cc:2267] T eb61d520b2e04186b48e156c321b7a87 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.221199 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.221671 20003 raft_consensus.cc:2238] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.222169 20003 raft_consensus.cc:2267] T b099b1062f574cac8c7d6ea4b425d639 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.223888 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.224447 20003 raft_consensus.cc:2238] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.224826 20003 raft_consensus.cc:2267] T ef674a6d97ef453288aac671f539707c P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.226828 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.227521 20003 raft_consensus.cc:2238] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.228030 20003 raft_consensus.cc:2267] T 1a650b5afdf747e5b2efa98da645c5ed P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.230095 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.230641 20003 raft_consensus.cc:2238] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.231321 20003 raft_consensus.cc:2267] T 39ae691cd7d54ac7b9e143a80bff4799 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.233160 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.234009 20003 raft_consensus.cc:2238] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.234397 20003 raft_consensus.cc:2267] T 9657cd13da7346f3bc0bbe9be4cd54da P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.235431 22976 consensus_peers.cc:487] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.236377 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.237071 20003 raft_consensus.cc:2238] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.237401 20003 raft_consensus.cc:2267] T e7713f12f4e14c9dbf2c0c02c601fec8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.239348 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.239862 20003 raft_consensus.cc:2238] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.240525 20003 raft_consensus.cc:2267] T 35a60ca37e934a699afc4cea1348eeb6 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.241456 23051 consensus_peers.cc:487] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.242216 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.242775 20003 raft_consensus.cc:2238] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.243482 20003 raft_consensus.cc:2267] T 90cf2809271744d4a4616db6fc05551f P 51679b9f547940b6a8311fd6fab340f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.245357 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.246075 20003 raft_consensus.cc:2238] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.246878 20003 raft_consensus.cc:2267] T 599de49040a74fba9b64f8f5cd31e376 P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.248927 23126 consensus_peers.cc:487] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.249377 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.250147 20003 raft_consensus.cc:2238] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.250671 20003 raft_consensus.cc:2267] T a6503cd8bad54600a24017cfeed153d1 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.252604 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.253098 20003 raft_consensus.cc:2238] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.253448 20003 raft_consensus.cc:2267] T d316cfec4ecf4f989132abc75c89a161 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.255086 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.255587 20003 raft_consensus.cc:2238] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.255942 20003 raft_consensus.cc:2267] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.257630 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.258136 20003 raft_consensus.cc:2238] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.258984 20003 raft_consensus.cc:2267] T d63c66a4270c48cbb4a02ccefda3d871 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.261123 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.261811 20003 raft_consensus.cc:2238] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.262300 20003 raft_consensus.cc:2267] T c6bf7b2897e84ca68fca53cc84d8a95b P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.263520 23126 consensus_peers.cc:487] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.264554 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.265146 20003 raft_consensus.cc:2238] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.265843 20003 raft_consensus.cc:2267] T e6afbf946f284e519b91063ad62d781a P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.268092 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.268712 20003 raft_consensus.cc:2238] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.269122 20003 raft_consensus.cc:2267] T 5ebf49030ef4421098214f70740e598f P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.269138 22976 consensus_peers.cc:487] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.271198 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.271730 20003 raft_consensus.cc:2238] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.272068 20003 raft_consensus.cc:2267] T fd29e1c05b4a4a5092fada7c6d4e2b21 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.273792 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.274518 20003 raft_consensus.cc:2238] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.274899 20003 raft_consensus.cc:2267] T f43fbf50f6a242cc91616f51d41df9b2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.276854 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.277341 20003 raft_consensus.cc:2238] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.277676 20003 raft_consensus.cc:2267] T c8e82f7c977e4539b1368607513bc151 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.279520 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.279997 20003 raft_consensus.cc:2238] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.280390 20003 raft_consensus.cc:2267] T f4a6a46398de4d2f994691863b60ded9 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.282649 20003 tablet_replica.cc:331] stopping tablet replica
W20250109 21:11:23.282792 23051 consensus_peers.cc:487] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.283401 20003 raft_consensus.cc:2238] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250109 21:11:23.283433 23126 consensus_peers.cc:487] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.283941 20003 raft_consensus.cc:2267] T 4b8f3a239a93458eab441de7a47bf286 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.285647 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.286123 20003 raft_consensus.cc:2238] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.286502 20003 raft_consensus.cc:2267] T 46e8872c00294570b6f9beecbcffa034 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.288189 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.288761 20003 raft_consensus.cc:2238] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.289098 20003 raft_consensus.cc:2267] T 436eb85c9e1e4c93afaa8e19215808a8 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.290789 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.291280 20003 raft_consensus.cc:2238] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.291920 20003 raft_consensus.cc:2267] T 11f80cf1724045a18b8e19fcc3e57c5f P 51679b9f547940b6a8311fd6fab340f7 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.293547 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.293977 20003 raft_consensus.cc:2238] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.294333 20003 raft_consensus.cc:2267] T ec0202de32424df98541f334960f7fe2 P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.296326 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.296782 20003 raft_consensus.cc:2238] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.297461 20003 raft_consensus.cc:2267] T f77b5e306c7d4f8884ceab7a4fd81b55 P 51679b9f547940b6a8311fd6fab340f7 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.299208 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.299860 20003 raft_consensus.cc:2238] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.300274 20003 raft_consensus.cc:2267] T f7fab26983594ff9be82f13812a1e49f P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.302645 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.303272 20003 raft_consensus.cc:2238] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.303771 20003 raft_consensus.cc:2267] T cbd7a89d4ce745659bb16e1e800506ba P 51679b9f547940b6a8311fd6fab340f7 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.305527 23051 consensus_peers.cc:487] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.306128 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.306628 20003 raft_consensus.cc:2238] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.307317 20003 raft_consensus.cc:2267] T 398bc3fa45cb462e85dc87212af53ec3 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.308912 20003 tablet_replica.cc:331] stopping tablet replica
I20250109 21:11:23.309334 20003 raft_consensus.cc:2238] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.309980 20003 raft_consensus.cc:2267] T ed33dab38b804fefb73e51dca12d3867 P 51679b9f547940b6a8311fd6fab340f7 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.330744 23126 consensus_peers.cc:487] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.335726 22976 consensus_peers.cc:487] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.366959 23126 consensus_peers.cc:487] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.369010 22976 consensus_peers.cc:487] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.370699 22976 consensus_peers.cc:487] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.373994 20003 tablet_server.cc:195] TabletServer@127.19.136.193:44075 shutdown complete.
W20250109 21:11:23.393129 23126 consensus_peers.cc:487] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.407172 22976 consensus_peers.cc:487] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.408857 23126 consensus_peers.cc:487] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.435736 22976 consensus_peers.cc:487] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.448743 20003 tablet_server.cc:178] TabletServer@127.19.136.194:0 shutting down...
I20250109 21:11:23.483037 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:11:23.483757 20003 tablet_replica.cc:331] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.484678 20003 raft_consensus.cc:2238] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.485466 20003 raft_consensus.cc:2267] T fd29e1c05b4a4a5092fada7c6d4e2b21 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.487216 20003 tablet_replica.cc:331] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.487728 20003 raft_consensus.cc:2238] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.488034 20003 raft_consensus.cc:2267] T 75760788e49142f3b4fe4024c99a2148 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.489543 20003 tablet_replica.cc:331] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.490032 20003 raft_consensus.cc:2238] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.490362 20003 raft_consensus.cc:2267] T 4b8f3a239a93458eab441de7a47bf286 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.491859 20003 tablet_replica.cc:331] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.492305 20003 raft_consensus.cc:2238] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.492682 20003 raft_consensus.cc:2267] T cbd7a89d4ce745659bb16e1e800506ba P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.494269 20003 tablet_replica.cc:331] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.494792 20003 raft_consensus.cc:2238] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.495518 20003 raft_consensus.cc:2267] T be8d475138234afd9334c27a5ef7b9ef P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.497200 20003 tablet_replica.cc:331] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.497691 20003 raft_consensus.cc:2238] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.498034 20003 raft_consensus.cc:2267] T c762018d1be74ce190b41ebd28a2e93e P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.499668 20003 tablet_replica.cc:331] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.500116 20003 raft_consensus.cc:2238] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.500471 20003 raft_consensus.cc:2267] T c680a42bcf4d467a9cf94539658db79b P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.502171 20003 tablet_replica.cc:331] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.502781 20003 raft_consensus.cc:2238] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.503152 20003 raft_consensus.cc:2267] T e85cb6e4e45a40ed966b3016f17f0b08 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.504971 20003 tablet_replica.cc:331] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.505443 20003 raft_consensus.cc:2238] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
W20250109 21:11:23.505542 23051 consensus_peers.cc:487] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.505820 20003 raft_consensus.cc:2267] T 58e256470c0347368a2757ad2e66e833 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.505985 23051 consensus_peers.cc:487] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.507464 20003 tablet_replica.cc:331] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.507994 20003 raft_consensus.cc:2238] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.508327 20003 raft_consensus.cc:2267] T 0c859bd141e74dbd810b500fd5244d26 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.510164 20003 tablet_replica.cc:331] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.510870 20003 raft_consensus.cc:2238] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.511760 20003 raft_consensus.cc:2267] T ef674a6d97ef453288aac671f539707c P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.513875 23051 consensus_peers.cc:487] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.514706 20003 tablet_replica.cc:331] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.515429 20003 raft_consensus.cc:2238] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.515884 20003 raft_consensus.cc:2267] T 4c150b5bc7644fcb865799e65af066f3 P df8c84b03e6f4a5288bdad949ba2447c [term 4 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.517433 23124 consensus_peers.cc:487] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.517848 20003 tablet_replica.cc:331] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
W20250109 21:11:23.518025 23126 consensus_peers.cc:487] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.518538 20003 raft_consensus.cc:2238] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.518946 20003 raft_consensus.cc:2267] T 125b38b701634accb2448016a89bc27f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.521380 20003 tablet_replica.cc:331] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
W20250109 21:11:23.521937 23124 consensus_peers.cc:487] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.522148 20003 raft_consensus.cc:2238] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.523157 20003 raft_consensus.cc:2267] T ec0202de32424df98541f334960f7fe2 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.525589 20003 tablet_replica.cc:331] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.526243 20003 raft_consensus.cc:2238] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Raft consensus shutting down.
W20250109 21:11:23.527072 23126 consensus_peers.cc:487] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.527211 20003 raft_consensus.cc:2267] T 5b7026bf15ee44938af84fc1397872aa P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.527426 23126 consensus_peers.cc:487] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.529049 20003 tablet_replica.cc:331] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.529654 20003 raft_consensus.cc:2238] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.530303 20003 raft_consensus.cc:2267] T 5ebf49030ef4421098214f70740e598f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.531997 20003 tablet_replica.cc:331] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.532480 20003 raft_consensus.cc:2238] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.532835 20003 raft_consensus.cc:2267] T e6afbf946f284e519b91063ad62d781a P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.534400 20003 tablet_replica.cc:331] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.534935 20003 raft_consensus.cc:2238] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.535310 20003 raft_consensus.cc:2267] T c6bf7b2897e84ca68fca53cc84d8a95b P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.537135 20003 tablet_replica.cc:331] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.537580 20003 raft_consensus.cc:2238] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.537905 20003 raft_consensus.cc:2267] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.539572 20003 tablet_replica.cc:331] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.540043 20003 raft_consensus.cc:2238] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.540364 20003 raft_consensus.cc:2267] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.541832 20003 tablet_replica.cc:331] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.542232 20003 raft_consensus.cc:2238] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.542526 20003 raft_consensus.cc:2267] T d316cfec4ecf4f989132abc75c89a161 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.544075 20003 tablet_replica.cc:331] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.544622 20003 raft_consensus.cc:2238] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.545209 20003 raft_consensus.cc:2267] T e4f32bf225644269afca55cb6491e09a P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.546834 20003 tablet_replica.cc:331] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.547287 20003 raft_consensus.cc:2238] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.547629 20003 raft_consensus.cc:2267] T e27c19622df5416eb965291aeb863154 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.549219 20003 tablet_replica.cc:331] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.549836 20003 raft_consensus.cc:2238] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.550190 20003 raft_consensus.cc:2267] T fcdcdd56a86d4793892b6a99883be239 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.551743 20003 tablet_replica.cc:331] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.552170 20003 raft_consensus.cc:2238] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.552773 20003 raft_consensus.cc:2267] T 19866aa90bdd4d5e91b1ac29ae31743f P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.554473 20003 tablet_replica.cc:331] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.554988 20003 raft_consensus.cc:2238] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.555702 20003 raft_consensus.cc:2267] T 414f03400b5e43529a493c039a7b7024 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.557770 20003 tablet_replica.cc:331] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.558388 20003 raft_consensus.cc:2238] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.559244 20003 raft_consensus.cc:2267] T a6503cd8bad54600a24017cfeed153d1 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.559684 23051 consensus_peers.cc:487] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.561508 20003 tablet_replica.cc:331] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.562168 20003 raft_consensus.cc:2238] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.562559 20003 raft_consensus.cc:2267] T 599de49040a74fba9b64f8f5cd31e376 P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.563215 23051 consensus_peers.cc:487] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.564345 20003 tablet_replica.cc:331] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.565002 20003 raft_consensus.cc:2238] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.565505 20003 raft_consensus.cc:2267] T ed33dab38b804fefb73e51dca12d3867 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.566829 23124 consensus_peers.cc:487] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.567675 20003 tablet_replica.cc:331] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.568176 20003 raft_consensus.cc:2238] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.568493 20003 raft_consensus.cc:2267] T 5d34599026c142fb83163497006fbfb5 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.570176 20003 tablet_replica.cc:331] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.570677 20003 raft_consensus.cc:2238] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.571419 20003 raft_consensus.cc:2267] T 9657cd13da7346f3bc0bbe9be4cd54da P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.573149 20003 tablet_replica.cc:331] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.573680 20003 raft_consensus.cc:2238] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.574043 20003 raft_consensus.cc:2267] T 35a60ca37e934a699afc4cea1348eeb6 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.574999 23051 consensus_peers.cc:487] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.575850 20003 tablet_replica.cc:331] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.576388 20003 raft_consensus.cc:2238] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.577162 20003 raft_consensus.cc:2267] T e7713f12f4e14c9dbf2c0c02c601fec8 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.579380 20003 tablet_replica.cc:331] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
W20250109 21:11:23.579572 23124 consensus_peers.cc:487] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.580062 20003 raft_consensus.cc:2238] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.580461 20003 raft_consensus.cc:2267] T 1df676409e0c4c1ca1dc047d238e4a14 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.582113 20003 tablet_replica.cc:331] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.582556 20003 raft_consensus.cc:2238] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.583247 20003 raft_consensus.cc:2267] T 1a650b5afdf747e5b2efa98da645c5ed P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.584870 20003 tablet_replica.cc:331] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.585315 20003 raft_consensus.cc:2238] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.585665 20003 raft_consensus.cc:2267] T 39ae691cd7d54ac7b9e143a80bff4799 P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.587239 20003 tablet_replica.cc:331] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.587668 20003 raft_consensus.cc:2238] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.587977 20003 raft_consensus.cc:2267] T f4a6a46398de4d2f994691863b60ded9 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.589469 20003 tablet_replica.cc:331] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.589906 20003 raft_consensus.cc:2238] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.590224 20003 raft_consensus.cc:2267] T c8e82f7c977e4539b1368607513bc151 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.591784 20003 tablet_replica.cc:331] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.592211 20003 raft_consensus.cc:2238] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.592571 20003 raft_consensus.cc:2267] T cbb4bf7d44374f9d9d8dffad767ec200 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.594619 20003 tablet_replica.cc:331] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.595223 20003 raft_consensus.cc:2238] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
W20250109 21:11:23.595296 23049 consensus_peers.cc:487] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.595675 20003 raft_consensus.cc:2267] T 436eb85c9e1e4c93afaa8e19215808a8 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.597376 20003 tablet_replica.cc:331] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.597842 20003 raft_consensus.cc:2238] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.598208 20003 raft_consensus.cc:2267] T 2732f8eccc4e4e6499255672a626b4a2 P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.599992 20003 tablet_replica.cc:331] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.600450 20003 raft_consensus.cc:2238] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.601199 20003 raft_consensus.cc:2267] T b5bdc088c0764e47a32e093893889baf P df8c84b03e6f4a5288bdad949ba2447c [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.602785 20003 tablet_replica.cc:331] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.603209 20003 raft_consensus.cc:2238] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.603592 20003 raft_consensus.cc:2267] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P df8c84b03e6f4a5288bdad949ba2447c [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.605222 20003 tablet_replica.cc:331] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c: stopping tablet replica
I20250109 21:11:23.605609 20003 raft_consensus.cc:2238] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.606302 20003 raft_consensus.cc:2267] T 3fde04e5e5c34372a88503ab457cda0e P df8c84b03e6f4a5288bdad949ba2447c [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.609054 23124 consensus_peers.cc:487] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.618373 23049 consensus_peers.cc:487] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.666976 23049 consensus_peers.cc:487] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.694311 20003 tablet_server.cc:195] TabletServer@127.19.136.194:0 shutdown complete.
W20250109 21:11:23.700632 23124 consensus_peers.cc:487] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.695495 23049 consensus_peers.cc:487] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.715546 23126 consensus_peers.cc:487] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 -> Peer 51679b9f547940b6a8311fd6fab340f7 (127.19.136.193:44075): Couldn't send request to peer 51679b9f547940b6a8311fd6fab340f7. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:44075: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.739496 23124 consensus_peers.cc:487] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.744812 23049 consensus_peers.cc:487] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.749269 23124 consensus_peers.cc:487] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.751727 23124 consensus_peers.cc:487] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.773830 20003 tablet_server.cc:178] TabletServer@127.19.136.195:0 shutting down...
W20250109 21:11:23.779313 23049 consensus_peers.cc:487] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.791273 23049 consensus_peers.cc:487] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.791718 23049 consensus_peers.cc:487] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.807017 23125 consensus_peers.cc:487] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 -> Peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Couldn't send request to peer e1a492f3cf3a4827bb0045500a3abb83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.818320 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:11:23.819142 20003 tablet_replica.cc:331] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.819980 20003 raft_consensus.cc:2238] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.820528 20003 raft_consensus.cc:2267] T fd29e1c05b4a4a5092fada7c6d4e2b21 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.822451 20003 tablet_replica.cc:331] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.823017 20003 raft_consensus.cc:2238] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.823424 20003 raft_consensus.cc:2267] T fe0ebd1c0ccc476b9d29f49ee9429849 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.825026 20003 tablet_replica.cc:331] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.825572 20003 raft_consensus.cc:2238] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.826231 20003 raft_consensus.cc:2267] T e85cb6e4e45a40ed966b3016f17f0b08 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.827991 20003 tablet_replica.cc:331] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.828747 20003 raft_consensus.cc:2238] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.829597 20003 raft_consensus.cc:2267] T c762018d1be74ce190b41ebd28a2e93e P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.831086 23049 consensus_peers.cc:487] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.831645 20003 tablet_replica.cc:331] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.832238 20003 raft_consensus.cc:2238] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.832604 20003 raft_consensus.cc:2267] T 58e256470c0347368a2757ad2e66e833 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.834147 20003 tablet_replica.cc:331] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.834663 20003 raft_consensus.cc:2238] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.835068 20003 raft_consensus.cc:2267] T 0c859bd141e74dbd810b500fd5244d26 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.836723 20003 tablet_replica.cc:331] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.837208 20003 raft_consensus.cc:2238] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.837852 20003 raft_consensus.cc:2267] T f43fbf50f6a242cc91616f51d41df9b2 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.839687 20003 tablet_replica.cc:331] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.840335 20003 raft_consensus.cc:2238] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.841125 20003 raft_consensus.cc:2267] T c680a42bcf4d467a9cf94539658db79b P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.841998 23125 consensus_peers.cc:487] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 -> Peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Couldn't send request to peer e1a492f3cf3a4827bb0045500a3abb83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.843088 20003 tablet_replica.cc:331] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.843636 20003 raft_consensus.cc:2238] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.843978 20003 raft_consensus.cc:2267] T 90cf2809271744d4a4616db6fc05551f P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.845512 20003 tablet_replica.cc:331] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.845991 20003 raft_consensus.cc:2238] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.846318 20003 raft_consensus.cc:2267] T 599de49040a74fba9b64f8f5cd31e376 P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.847879 20003 tablet_replica.cc:331] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.848371 20003 raft_consensus.cc:2238] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.848713 20003 raft_consensus.cc:2267] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.850325 20003 tablet_replica.cc:331] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.850811 20003 raft_consensus.cc:2238] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.851192 20003 raft_consensus.cc:2267] T b099b1062f574cac8c7d6ea4b425d639 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.852747 20003 tablet_replica.cc:331] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.853196 20003 raft_consensus.cc:2238] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.853514 20003 raft_consensus.cc:2267] T ef674a6d97ef453288aac671f539707c P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.855103 20003 tablet_replica.cc:331] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.855537 20003 raft_consensus.cc:2238] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.856166 20003 raft_consensus.cc:2267] T f4a6a46398de4d2f994691863b60ded9 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.857722 20003 tablet_replica.cc:331] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.858189 20003 raft_consensus.cc:2238] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.858825 20003 raft_consensus.cc:2267] T cbb4bf7d44374f9d9d8dffad767ec200 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.860502 20003 tablet_replica.cc:331] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.861099 20003 raft_consensus.cc:2238] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.861567 20003 raft_consensus.cc:2267] T e6afbf946f284e519b91063ad62d781a P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.863484 20003 tablet_replica.cc:331] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.863950 20003 raft_consensus.cc:2238] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.864270 20003 raft_consensus.cc:2267] T 5b7026bf15ee44938af84fc1397872aa P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.865829 20003 tablet_replica.cc:331] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.866236 20003 raft_consensus.cc:2238] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.866537 20003 raft_consensus.cc:2267] T d63c66a4270c48cbb4a02ccefda3d871 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.867995 20003 tablet_replica.cc:331] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.868451 20003 raft_consensus.cc:2238] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.868778 20003 raft_consensus.cc:2267] T e4f32bf225644269afca55cb6491e09a P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.871017 20003 tablet_replica.cc:331] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.871511 20003 raft_consensus.cc:2238] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.872090 20003 raft_consensus.cc:2267] T fcdcdd56a86d4793892b6a99883be239 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.873497 20003 tablet_replica.cc:331] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.873914 20003 raft_consensus.cc:2238] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.874269 20003 raft_consensus.cc:2267] T 11f80cf1724045a18b8e19fcc3e57c5f P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.875748 20003 tablet_replica.cc:331] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.876235 20003 raft_consensus.cc:2238] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.877015 20003 raft_consensus.cc:2267] T 4b8f3a239a93458eab441de7a47bf286 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.879042 20003 tablet_replica.cc:331] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.879635 20003 raft_consensus.cc:2238] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Raft consensus shutting down.
W20250109 21:11:23.879997 23049 consensus_peers.cc:487] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:23.880448 20003 raft_consensus.cc:2267] T 46e8872c00294570b6f9beecbcffa034 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.882095 20003 tablet_replica.cc:331] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.882613 20003 raft_consensus.cc:2238] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.883009 20003 raft_consensus.cc:2267] T ed33dab38b804fefb73e51dca12d3867 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.884687 20003 tablet_replica.cc:331] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.885156 20003 raft_consensus.cc:2238] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.885504 20003 raft_consensus.cc:2267] T 4c150b5bc7644fcb865799e65af066f3 P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.887238 20003 tablet_replica.cc:331] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.887751 20003 raft_consensus.cc:2238] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.888422 20003 raft_consensus.cc:2267] T 125b38b701634accb2448016a89bc27f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.889979 20003 tablet_replica.cc:331] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.890439 20003 raft_consensus.cc:2238] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.890794 20003 raft_consensus.cc:2267] T 575f5547ec354edc8ac999aec2222318 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.892319 20003 tablet_replica.cc:331] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.892891 20003 raft_consensus.cc:2238] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.893329 20003 raft_consensus.cc:2267] T f7fab26983594ff9be82f13812a1e49f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.895937 20003 tablet_replica.cc:331] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.896482 20003 raft_consensus.cc:2238] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.896899 20003 raft_consensus.cc:2267] T f77b5e306c7d4f8884ceab7a4fd81b55 P e1a492f3cf3a4827bb0045500a3abb83 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.898867 20003 tablet_replica.cc:331] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.899363 20003 raft_consensus.cc:2238] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.899780 20003 raft_consensus.cc:2267] T 19866aa90bdd4d5e91b1ac29ae31743f P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.901895 20003 tablet_replica.cc:331] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.902539 20003 raft_consensus.cc:2238] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.902964 20003 raft_consensus.cc:2267] T 398bc3fa45cb462e85dc87212af53ec3 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.904807 20003 tablet_replica.cc:331] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.905282 20003 raft_consensus.cc:2238] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.905655 20003 raft_consensus.cc:2267] T 414f03400b5e43529a493c039a7b7024 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.907840 20003 tablet_replica.cc:331] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.908526 20003 raft_consensus.cc:2238] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.908978 20003 raft_consensus.cc:2267] T eb61d520b2e04186b48e156c321b7a87 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.911043 20003 tablet_replica.cc:331] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.911481 20003 raft_consensus.cc:2238] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.912142 20003 raft_consensus.cc:2267] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.913730 20003 tablet_replica.cc:331] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.914180 20003 raft_consensus.cc:2238] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.914817 20003 raft_consensus.cc:2267] T 4b4b07d8e80744b782d3fb265f1d0ca7 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.916715 20003 tablet_replica.cc:331] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.917205 20003 raft_consensus.cc:2238] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.917534 20003 raft_consensus.cc:2267] T 4309ed0e1fa847329590a19703399802 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.919100 20003 tablet_replica.cc:331] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.919557 20003 raft_consensus.cc:2238] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.919911 20003 raft_consensus.cc:2267] T 3fde04e5e5c34372a88503ab457cda0e P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.921571 20003 tablet_replica.cc:331] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.922176 20003 raft_consensus.cc:2238] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.922641 20003 raft_consensus.cc:2267] T e7713f12f4e14c9dbf2c0c02c601fec8 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.924994 20003 tablet_replica.cc:331] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.925519 20003 raft_consensus.cc:2238] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.926443 20003 raft_consensus.cc:2267] T 5d34599026c142fb83163497006fbfb5 P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.928913 20003 tablet_replica.cc:331] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.929589 20003 raft_consensus.cc:2238] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.930058 20003 raft_consensus.cc:2267] T b5bdc088c0764e47a32e093893889baf P e1a492f3cf3a4827bb0045500a3abb83 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.931818 20003 tablet_replica.cc:331] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.932252 20003 raft_consensus.cc:2238] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.933076 20003 raft_consensus.cc:2267] T f1ba1f1f4b844cbeafa6098ff5b3a7ce P e1a492f3cf3a4827bb0045500a3abb83 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.935173 20003 tablet_replica.cc:331] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.935643 20003 raft_consensus.cc:2238] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.936100 20003 raft_consensus.cc:2267] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.938128 20003 tablet_replica.cc:331] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.938764 20003 raft_consensus.cc:2238] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:23.939453 20003 raft_consensus.cc:2267] T 1df676409e0c4c1ca1dc047d238e4a14 P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:23.941293 20003 tablet_replica.cc:331] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83: stopping tablet replica
I20250109 21:11:23.941757 20003 raft_consensus.cc:2238] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:23.942142 20003 raft_consensus.cc:2267] T 1a650b5afdf747e5b2efa98da645c5ed P e1a492f3cf3a4827bb0045500a3abb83 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:23.955731 23125 consensus_peers.cc:487] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 -> Peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Couldn't send request to peer e1a492f3cf3a4827bb0045500a3abb83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.956257 23125 consensus_peers.cc:487] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 -> Peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Couldn't send request to peer e1a492f3cf3a4827bb0045500a3abb83. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:23.976152 23124 consensus_peers.cc:487] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 -> Peer df8c84b03e6f4a5288bdad949ba2447c (127.19.136.194:39559): Couldn't send request to peer df8c84b03e6f4a5288bdad949ba2447c. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:39559: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:24.004971 20003 tablet_server.cc:195] TabletServer@127.19.136.195:0 shutdown complete.
I20250109 21:11:24.060243 20003 tablet_server.cc:178] TabletServer@127.19.136.196:0 shutting down...
W20250109 21:11:24.098405 23125 consensus_peers.cc:487] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 -> Peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Couldn't send request to peer e1a492f3cf3a4827bb0045500a3abb83. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.195:32985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:24.112035 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:11:24.112695 20003 tablet_replica.cc:331] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.113263 20003 raft_consensus.cc:2238] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.113663 20003 raft_consensus.cc:2267] T b5bdc088c0764e47a32e093893889baf P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.115460 20003 tablet_replica.cc:331] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.115991 20003 raft_consensus.cc:2238] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.116755 20003 raft_consensus.cc:2267] T 2732f8eccc4e4e6499255672a626b4a2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:24.117792 23125 consensus_peers.cc:487] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 -> Peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Couldn't send request to peer e1a492f3cf3a4827bb0045500a3abb83. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.195:32985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:24.118705 20003 tablet_replica.cc:331] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.119273 20003 raft_consensus.cc:2238] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.119663 20003 raft_consensus.cc:2267] T be8d475138234afd9334c27a5ef7b9ef P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.121281 20003 tablet_replica.cc:331] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.121803 20003 raft_consensus.cc:2238] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.122138 20003 raft_consensus.cc:2267] T 75760788e49142f3b4fe4024c99a2148 P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.123740 20003 tablet_replica.cc:331] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.124210 20003 raft_consensus.cc:2238] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.124857 20003 raft_consensus.cc:2267] T b099b1062f574cac8c7d6ea4b425d639 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.126521 20003 tablet_replica.cc:331] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.127058 20003 raft_consensus.cc:2238] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.127374 20003 raft_consensus.cc:2267] T e85cb6e4e45a40ed966b3016f17f0b08 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.128928 20003 tablet_replica.cc:331] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.129421 20003 raft_consensus.cc:2238] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.130071 20003 raft_consensus.cc:2267] T cbd7a89d4ce745659bb16e1e800506ba P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.131883 20003 tablet_replica.cc:331] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.132336 20003 raft_consensus.cc:2238] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.132699 20003 raft_consensus.cc:2267] T 7ea2612c1c6e4ee6b27cc5626e5fc981 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.134694 20003 tablet_replica.cc:331] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.135322 20003 raft_consensus.cc:2238] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.135758 20003 raft_consensus.cc:2267] T fe0ebd1c0ccc476b9d29f49ee9429849 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:24.137403 23125 consensus_peers.cc:487] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 -> Peer e1a492f3cf3a4827bb0045500a3abb83 (127.19.136.195:32985): Couldn't send request to peer e1a492f3cf3a4827bb0045500a3abb83. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.195:32985: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:24.137959 20003 tablet_replica.cc:331] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.138736 20003 raft_consensus.cc:2238] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.139715 20003 raft_consensus.cc:2267] T eb61d520b2e04186b48e156c321b7a87 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.142035 20003 tablet_replica.cc:331] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.142709 20003 raft_consensus.cc:2238] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.143591 20003 raft_consensus.cc:2267] T 0c859bd141e74dbd810b500fd5244d26 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.145903 20003 tablet_replica.cc:331] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.146585 20003 raft_consensus.cc:2238] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.147053 20003 raft_consensus.cc:2267] T f77b5e306c7d4f8884ceab7a4fd81b55 P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.149335 20003 tablet_replica.cc:331] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.150035 20003 raft_consensus.cc:2238] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.150511 20003 raft_consensus.cc:2267] T ec0202de32424df98541f334960f7fe2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.152838 20003 tablet_replica.cc:331] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.153553 20003 raft_consensus.cc:2238] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.154017 20003 raft_consensus.cc:2267] T f43fbf50f6a242cc91616f51d41df9b2 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.156276 20003 tablet_replica.cc:331] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.156957 20003 raft_consensus.cc:2238] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.157411 20003 raft_consensus.cc:2267] T c680a42bcf4d467a9cf94539658db79b P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.159732 20003 tablet_replica.cc:331] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.160429 20003 raft_consensus.cc:2238] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.160890 20003 raft_consensus.cc:2267] T d63c66a4270c48cbb4a02ccefda3d871 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.163170 20003 tablet_replica.cc:331] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.163861 20003 raft_consensus.cc:2238] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.164325 20003 raft_consensus.cc:2267] T e4f32bf225644269afca55cb6491e09a P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.166567 20003 tablet_replica.cc:331] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.167275 20003 raft_consensus.cc:2238] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.168141 20003 raft_consensus.cc:2267] T e27c19622df5416eb965291aeb863154 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.170432 20003 tablet_replica.cc:331] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.171141 20003 raft_consensus.cc:2238] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.172001 20003 raft_consensus.cc:2267] T 2eaeb5702b8c4c15a530b7f4bc0b1990 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.174292 20003 tablet_replica.cc:331] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.174978 20003 raft_consensus.cc:2238] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.175815 20003 raft_consensus.cc:2267] T c8e82f7c977e4539b1368607513bc151 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.178107 20003 tablet_replica.cc:331] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.178828 20003 raft_consensus.cc:2238] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.179303 20003 raft_consensus.cc:2267] T cbb4bf7d44374f9d9d8dffad767ec200 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.181644 20003 tablet_replica.cc:331] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.182355 20003 raft_consensus.cc:2238] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.183264 20003 raft_consensus.cc:2267] T c6bf7b2897e84ca68fca53cc84d8a95b P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.185550 20003 tablet_replica.cc:331] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.186295 20003 raft_consensus.cc:2238] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.186782 20003 raft_consensus.cc:2267] T 5ebf49030ef4421098214f70740e598f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.189033 20003 tablet_replica.cc:331] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.189742 20003 raft_consensus.cc:2238] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.190199 20003 raft_consensus.cc:2267] T 5b7026bf15ee44938af84fc1397872aa P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.192492 20003 tablet_replica.cc:331] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.193193 20003 raft_consensus.cc:2238] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.193665 20003 raft_consensus.cc:2267] T 11f80cf1724045a18b8e19fcc3e57c5f P 227e48f30ae84db6bff43cc2860219a3 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.195940 20003 tablet_replica.cc:331] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.196638 20003 raft_consensus.cc:2238] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.197535 20003 raft_consensus.cc:2267] T 436eb85c9e1e4c93afaa8e19215808a8 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.199838 20003 tablet_replica.cc:331] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.200529 20003 raft_consensus.cc:2238] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 4 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.201423 20003 raft_consensus.cc:2267] T 4c150b5bc7644fcb865799e65af066f3 P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.203586 20003 tablet_replica.cc:331] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.204211 20003 raft_consensus.cc:2238] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.205088 20003 raft_consensus.cc:2267] T 575f5547ec354edc8ac999aec2222318 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.206826 20003 tablet_replica.cc:331] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.207298 20003 raft_consensus.cc:2238] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.207931 20003 raft_consensus.cc:2267] T f7fab26983594ff9be82f13812a1e49f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.209476 20003 tablet_replica.cc:331] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.210005 20003 raft_consensus.cc:2238] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.210325 20003 raft_consensus.cc:2267] T 5d34599026c142fb83163497006fbfb5 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.212004 20003 tablet_replica.cc:331] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.212447 20003 raft_consensus.cc:2238] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.212790 20003 raft_consensus.cc:2267] T 19866aa90bdd4d5e91b1ac29ae31743f P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.214313 20003 tablet_replica.cc:331] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.214751 20003 raft_consensus.cc:2238] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.215126 20003 raft_consensus.cc:2267] T 398bc3fa45cb462e85dc87212af53ec3 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.216706 20003 tablet_replica.cc:331] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.217175 20003 raft_consensus.cc:2238] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.217541 20003 raft_consensus.cc:2267] T 414f03400b5e43529a493c039a7b7024 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.219179 20003 tablet_replica.cc:331] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.219652 20003 raft_consensus.cc:2238] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.220014 20003 raft_consensus.cc:2267] T 46e8872c00294570b6f9beecbcffa034 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.221588 20003 tablet_replica.cc:331] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.222036 20003 raft_consensus.cc:2238] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.222394 20003 raft_consensus.cc:2267] T 39ae691cd7d54ac7b9e143a80bff4799 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.223945 20003 tablet_replica.cc:331] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.224396 20003 raft_consensus.cc:2238] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.224769 20003 raft_consensus.cc:2267] T 9657cd13da7346f3bc0bbe9be4cd54da P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.226996 20003 tablet_replica.cc:331] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.227452 20003 raft_consensus.cc:2238] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.227800 20003 raft_consensus.cc:2267] T 35a60ca37e934a699afc4cea1348eeb6 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.229388 20003 tablet_replica.cc:331] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.229840 20003 raft_consensus.cc:2238] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.230206 20003 raft_consensus.cc:2267] T 1700a41cd4c54a0d8b7e2e23d22f18a5 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.231801 20003 tablet_replica.cc:331] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.232255 20003 raft_consensus.cc:2238] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.232954 20003 raft_consensus.cc:2267] T d316cfec4ecf4f989132abc75c89a161 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.234588 20003 tablet_replica.cc:331] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.235095 20003 raft_consensus.cc:2238] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.235450 20003 raft_consensus.cc:2267] T 4b4b07d8e80744b782d3fb265f1d0ca7 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.237179 20003 tablet_replica.cc:331] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.237639 20003 raft_consensus.cc:2238] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.238289 20003 raft_consensus.cc:2267] T 4309ed0e1fa847329590a19703399802 P 227e48f30ae84db6bff43cc2860219a3 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.239907 20003 tablet_replica.cc:331] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.240343 20003 raft_consensus.cc:2238] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.240707 20003 raft_consensus.cc:2267] T 3fde04e5e5c34372a88503ab457cda0e P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.242307 20003 tablet_replica.cc:331] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.242713 20003 raft_consensus.cc:2238] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.243052 20003 raft_consensus.cc:2267] T 90cf2809271744d4a4616db6fc05551f P 227e48f30ae84db6bff43cc2860219a3 [term 4 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.244565 20003 tablet_replica.cc:331] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3: stopping tablet replica
I20250109 21:11:24.244938 20003 raft_consensus.cc:2238] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:24.245275 20003 raft_consensus.cc:2267] T a6503cd8bad54600a24017cfeed153d1 P 227e48f30ae84db6bff43cc2860219a3 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.344286 20003 tablet_server.cc:195] TabletServer@127.19.136.196:0 shutdown complete.
I20250109 21:11:24.399045 20003 master.cc:537] Master@127.19.136.254:39877 shutting down...
I20250109 21:11:24.425251 20003 raft_consensus.cc:2238] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:24.425721 20003 raft_consensus.cc:2267] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:24.425990 20003 tablet_replica.cc:331] T 00000000000000000000000000000000 P e180793815af495b9df31cdc04450648: stopping tablet replica
I20250109 21:11:24.446673 20003 master.cc:559] Master@127.19.136.254:39877 shutdown complete.
[ OK ] LeaderRebalancerTest.RestartTserver (32680 ms)
[ RUN ] LeaderRebalancerTest.TestMaintenanceMode
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:471: Skipped
test is skipped; set KUDU_ALLOW_SLOW_TESTS=1 to run
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode (6 ms)
[----------] 5 tests from LeaderRebalancerTest (140895 ms total)
[----------] 2 tests from FilterSoftDeletedTableTest
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0
I20250109 21:11:24.532052 20003 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.136.254:46761
I20250109 21:11:24.533020 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:24.538244 24137 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:24.539211 24138 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:24.539489 24140 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:24.539921 20003 server_base.cc:1034] running on GCE node
I20250109 21:11:24.540937 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:11:24.541137 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:24.541271 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457084541255 us; error 0 us; skew 500 ppm
I20250109 21:11:24.541735 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:11:24.548242 20003 webserver.cc:458] Webserver started at http://127.19.136.254:41755/ using document root <none> and password file <none>
I20250109 21:11:24.548720 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:11:24.548890 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:11:24.549129 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:11:24.550413 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/master-0-root/instance:
uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac"
format_stamp: "Formatted at 2025-01-09 21:11:24 on dist-test-slave-sc47"
I20250109 21:11:24.554711 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20250109 21:11:24.557797 24145 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:24.558514 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:11:24.558861 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/master-0-root
uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac"
format_stamp: "Formatted at 2025-01-09 21:11:24 on dist-test-slave-sc47"
I20250109 21:11:24.559185 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:11:24.573200 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:24.574378 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:24.635016 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.254:46761
I20250109 21:11:24.635114 24198 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.254:46761 every 8 connection(s)
I20250109 21:11:24.639801 24199 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:24.652526 24199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac: Bootstrap starting.
I20250109 21:11:24.657506 24199 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:24.661971 24199 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac: No bootstrap required, opened a new log
I20250109 21:11:24.664245 24199 raft_consensus.cc:357] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac" member_type: VOTER }
I20250109 21:11:24.664822 24199 raft_consensus.cc:383] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:24.665066 24199 raft_consensus.cc:738] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 3e7db19cc9f14bee9bd06ea2bb4bbaac, State: Initialized, Role: FOLLOWER
I20250109 21:11:24.665719 24199 consensus_queue.cc:260] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac" member_type: VOTER }
I20250109 21:11:24.666169 24199 raft_consensus.cc:397] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250109 21:11:24.666388 24199 raft_consensus.cc:491] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250109 21:11:24.666671 24199 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:24.671427 24199 raft_consensus.cc:513] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac" member_type: VOTER }
I20250109 21:11:24.671907 24199 leader_election.cc:304] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 3e7db19cc9f14bee9bd06ea2bb4bbaac; no voters:
I20250109 21:11:24.672979 24199 leader_election.cc:290] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [CANDIDATE]: Term 1 election: Requested vote from peers
I20250109 21:11:24.673374 24202 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:24.674703 24202 raft_consensus.cc:695] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 1 LEADER]: Becoming Leader. State: Replica: 3e7db19cc9f14bee9bd06ea2bb4bbaac, State: Running, Role: LEADER
I20250109 21:11:24.675488 24202 consensus_queue.cc:237] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac" member_type: VOTER }
I20250109 21:11:24.675994 24199 sys_catalog.cc:564] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [sys.catalog]: configured and running, proceeding with master startup.
I20250109 21:11:24.682289 24203 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac" member_type: VOTER } }
I20250109 21:11:24.683226 24203 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [sys.catalog]: This master's current role is: LEADER
I20250109 21:11:24.685213 24204 sys_catalog.cc:455] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [sys.catalog]: SysCatalogTable state changed. Reason: New leader 3e7db19cc9f14bee9bd06ea2bb4bbaac. Latest consensus state: current_term: 1 leader_uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "3e7db19cc9f14bee9bd06ea2bb4bbaac" member_type: VOTER } }
I20250109 21:11:24.685981 24204 sys_catalog.cc:458] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [sys.catalog]: This master's current role is: LEADER
I20250109 21:11:24.689677 24211 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250109 21:11:24.697669 24211 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250109 21:11:24.698710 20003 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250109 21:11:24.706408 24211 catalog_manager.cc:1348] Generated new cluster ID: 18adfe0eec0a414d8499bb7abe608b3d
I20250109 21:11:24.706701 24211 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250109 21:11:24.727543 24211 catalog_manager.cc:1371] Generated new certificate authority record
I20250109 21:11:24.728865 24211 catalog_manager.cc:1505] Loading token signing keys...
I20250109 21:11:24.748982 24211 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac: Generated new TSK 0
I20250109 21:11:24.749593 24211 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250109 21:11:24.765550 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:24.772523 24220 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:24.773813 24221 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:24.774947 24223 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:24.775844 20003 server_base.cc:1034] running on GCE node
I20250109 21:11:24.776727 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:11:24.776921 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:24.777034 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457084777023 us; error 0 us; skew 500 ppm
I20250109 21:11:24.777626 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:11:24.780042 20003 webserver.cc:458] Webserver started at http://127.19.136.193:41527/ using document root <none> and password file <none>
I20250109 21:11:24.780485 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:11:24.780658 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:11:24.780906 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:11:24.782176 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-0-root/instance:
uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
format_stamp: "Formatted at 2025-01-09 21:11:24 on dist-test-slave-sc47"
I20250109 21:11:24.786849 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250109 21:11:24.790215 24228 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:24.791069 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:11:24.791340 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-0-root
uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
format_stamp: "Formatted at 2025-01-09 21:11:24 on dist-test-slave-sc47"
I20250109 21:11:24.791636 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:11:24.802573 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:24.803800 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:24.805186 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:11:24.807554 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:11:24.807752 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:24.807981 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:11:24.808138 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:24.849916 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.193:42407
I20250109 21:11:24.850011 24290 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.193:42407 every 8 connection(s)
I20250109 21:11:24.856055 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:24.862358 24295 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:24.863363 24296 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:24.866506 20003 server_base.cc:1034] running on GCE node
W20250109 21:11:24.867403 24298 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:24.868327 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:11:24.868546 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:24.868763 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457084868734 us; error 0 us; skew 500 ppm
I20250109 21:11:24.869359 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:11:24.869462 24291 heartbeater.cc:346] Connected to a master server at 127.19.136.254:46761
I20250109 21:11:24.869861 24291 heartbeater.cc:463] Registering TS with master...
I20250109 21:11:24.870684 24291 heartbeater.cc:510] Master 127.19.136.254:46761 requested a full tablet report, sending...
I20250109 21:11:24.871905 20003 webserver.cc:458] Webserver started at http://127.19.136.194:35153/ using document root <none> and password file <none>
I20250109 21:11:24.872483 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:11:24.872681 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:11:24.872938 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:11:24.872870 24162 ts_manager.cc:194] Registered new tserver with Master: 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407)
I20250109 21:11:24.874394 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-1-root/instance:
uuid: "31e6940413e84966ab39625aa5d4ccc5"
format_stamp: "Formatted at 2025-01-09 21:11:24 on dist-test-slave-sc47"
I20250109 21:11:24.874986 24162 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49804
I20250109 21:11:24.880249 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.003s sys 0.000s
I20250109 21:11:24.883553 24303 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:24.884245 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:11:24.884505 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-1-root
uuid: "31e6940413e84966ab39625aa5d4ccc5"
format_stamp: "Formatted at 2025-01-09 21:11:24 on dist-test-slave-sc47"
I20250109 21:11:24.884794 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:11:24.901592 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:24.902771 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:24.904248 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:11:24.906440 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:11:24.906642 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:24.906864 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:11:24.907063 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20250109 21:11:24.945773 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.194:45507
I20250109 21:11:24.945868 24366 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.194:45507 every 8 connection(s)
I20250109 21:11:24.950662 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:24.959959 24371 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:24.959039 24370 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:24.962318 24367 heartbeater.cc:346] Connected to a master server at 127.19.136.254:46761
W20250109 21:11:24.962349 24373 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:24.962930 24367 heartbeater.cc:463] Registering TS with master...
I20250109 21:11:24.963860 24367 heartbeater.cc:510] Master 127.19.136.254:46761 requested a full tablet report, sending...
I20250109 21:11:24.963871 20003 server_base.cc:1034] running on GCE node
I20250109 21:11:24.964975 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:11:24.965173 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:24.965346 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457084965327 us; error 0 us; skew 500 ppm
I20250109 21:11:24.965881 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:11:24.966028 24162 ts_manager.cc:194] Registered new tserver with Master: 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:24.967646 24162 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49812
I20250109 21:11:24.968438 20003 webserver.cc:458] Webserver started at http://127.19.136.195:39469/ using document root <none> and password file <none>
I20250109 21:11:24.969017 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:11:24.969183 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:11:24.969439 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:11:24.970623 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-2-root/instance:
uuid: "90c75ac1abda40fd952cb7d88c7d753f"
format_stamp: "Formatted at 2025-01-09 21:11:24 on dist-test-slave-sc47"
I20250109 21:11:24.974807 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20250109 21:11:24.977967 24378 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:24.978662 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:11:24.978946 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-2-root
uuid: "90c75ac1abda40fd952cb7d88c7d753f"
format_stamp: "Formatted at 2025-01-09 21:11:24 on dist-test-slave-sc47"
I20250109 21:11:24.979192 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:11:25.004460 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:25.005635 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:25.007077 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:11:25.009174 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:11:25.009374 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:25.009621 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:11:25.009775 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:25.049088 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.195:34483
I20250109 21:11:25.049175 24440 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.195:34483 every 8 connection(s)
I20250109 21:11:25.062870 24441 heartbeater.cc:346] Connected to a master server at 127.19.136.254:46761
I20250109 21:11:25.063334 24441 heartbeater.cc:463] Registering TS with master...
I20250109 21:11:25.064057 24441 heartbeater.cc:510] Master 127.19.136.254:46761 requested a full tablet report, sending...
I20250109 21:11:25.065791 24162 ts_manager.cc:194] Registered new tserver with Master: 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.066802 20003 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.014521837s
I20250109 21:11:25.067049 24162 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:49822
I20250109 21:11:25.069183 20003 test_util.cc:274] Using random seed: 1807296360
I20250109 21:11:25.090628 24162 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:49838:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250109 21:11:25.093423 24162 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250109 21:11:25.171526 24256 tablet_service.cc:1467] Processing CreateTablet for tablet 39f608b6f2484784be332e75fc641b47 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:25.173055 24256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f608b6f2484784be332e75fc641b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.174134 24406 tablet_service.cc:1467] Processing CreateTablet for tablet 39f608b6f2484784be332e75fc641b47 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:25.174309 24251 tablet_service.cc:1467] Processing CreateTablet for tablet 47768a3814874f04ac7599523949bd81 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:25.175755 24251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47768a3814874f04ac7599523949bd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.176100 24405 tablet_service.cc:1467] Processing CreateTablet for tablet 691aaa81f1d6437da0eb8c8ec267a1a2 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:25.177281 24254 tablet_service.cc:1467] Processing CreateTablet for tablet c234860bfa0449b58932d751ed0c8e7d (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:25.178113 24404 tablet_service.cc:1467] Processing CreateTablet for tablet c234860bfa0449b58932d751ed0c8e7d (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:25.178671 24254 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c234860bfa0449b58932d751ed0c8e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.182310 24330 tablet_service.cc:1467] Processing CreateTablet for tablet 691aaa81f1d6437da0eb8c8ec267a1a2 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:25.183732 24401 tablet_service.cc:1467] Processing CreateTablet for tablet 47768a3814874f04ac7599523949bd81 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:25.178318 24250 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef9bafd58c04d77b597d7dc1570df26 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:25.185400 24329 tablet_service.cc:1467] Processing CreateTablet for tablet c234860bfa0449b58932d751ed0c8e7d (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:25.185745 24400 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef9bafd58c04d77b597d7dc1570df26 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:25.186708 24250 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef9bafd58c04d77b597d7dc1570df26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.179756 24331 tablet_service.cc:1467] Processing CreateTablet for tablet 39f608b6f2484784be332e75fc641b47 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:25.188012 24399 tablet_service.cc:1467] Processing CreateTablet for tablet d6d844a03cb4427999b61cac0644403d (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:25.188633 24328 tablet_service.cc:1467] Processing CreateTablet for tablet 98a0770c333f4e0881b843f212d91888 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:25.190093 24398 tablet_service.cc:1467] Processing CreateTablet for tablet 50630bfe825448bab1eaa3beb904b50b (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:25.192114 24327 tablet_service.cc:1467] Processing CreateTablet for tablet 859d68415c0b4960b495b4ab9d067e3c (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:25.194409 24326 tablet_service.cc:1467] Processing CreateTablet for tablet 47768a3814874f04ac7599523949bd81 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:25.196565 24323 tablet_service.cc:1467] Processing CreateTablet for tablet 50630bfe825448bab1eaa3beb904b50b (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:25.197017 24325 tablet_service.cc:1467] Processing CreateTablet for tablet 1ef9bafd58c04d77b597d7dc1570df26 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:25.180155 24253 tablet_service.cc:1467] Processing CreateTablet for tablet 98a0770c333f4e0881b843f212d91888 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:25.181334 24252 tablet_service.cc:1467] Processing CreateTablet for tablet 859d68415c0b4960b495b4ab9d067e3c (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:25.181911 24402 tablet_service.cc:1467] Processing CreateTablet for tablet 859d68415c0b4960b495b4ab9d067e3c (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:25.180160 24249 tablet_service.cc:1467] Processing CreateTablet for tablet d6d844a03cb4427999b61cac0644403d (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:25.201766 24253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a0770c333f4e0881b843f212d91888. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.202423 24252 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859d68415c0b4960b495b4ab9d067e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.198966 24324 tablet_service.cc:1467] Processing CreateTablet for tablet d6d844a03cb4427999b61cac0644403d (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:25.183734 24330 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691aaa81f1d6437da0eb8c8ec267a1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.180123 24403 tablet_service.cc:1467] Processing CreateTablet for tablet 98a0770c333f4e0881b843f212d91888 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:25.181934 24248 tablet_service.cc:1467] Processing CreateTablet for tablet 50630bfe825448bab1eaa3beb904b50b (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:25.176107 24255 tablet_service.cc:1467] Processing CreateTablet for tablet 691aaa81f1d6437da0eb8c8ec267a1a2 (DEFAULT_TABLE table=test-workload [id=157fc7c55d1e4de2b2e0f23199e0cfcf]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:25.207602 24248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50630bfe825448bab1eaa3beb904b50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.208386 24255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691aaa81f1d6437da0eb8c8ec267a1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.208860 24328 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a0770c333f4e0881b843f212d91888. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.211236 24329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c234860bfa0449b58932d751ed0c8e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.215230 24331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f608b6f2484784be332e75fc641b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.216197 24325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef9bafd58c04d77b597d7dc1570df26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.219221 24327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859d68415c0b4960b495b4ab9d067e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.223217 24249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d844a03cb4427999b61cac0644403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.227228 24326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47768a3814874f04ac7599523949bd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.231287 24323 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50630bfe825448bab1eaa3beb904b50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.202699 24406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 39f608b6f2484784be332e75fc641b47. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.236840 24400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1ef9bafd58c04d77b597d7dc1570df26. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.237326 24456 tablet_bootstrap.cc:492] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.237462 24405 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 691aaa81f1d6437da0eb8c8ec267a1a2. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.239046 24324 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d844a03cb4427999b61cac0644403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.239209 24402 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 859d68415c0b4960b495b4ab9d067e3c. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.243189 24399 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d6d844a03cb4427999b61cac0644403d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.244131 24404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c234860bfa0449b58932d751ed0c8e7d. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.251113 24398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 50630bfe825448bab1eaa3beb904b50b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.258320 24456 tablet_bootstrap.cc:654] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.259214 24403 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 98a0770c333f4e0881b843f212d91888. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.275950 24401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 47768a3814874f04ac7599523949bd81. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:25.331588 24458 tablet_bootstrap.cc:492] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.335474 24459 tablet_bootstrap.cc:492] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.338665 24458 tablet_bootstrap.cc:654] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.341853 24456 tablet_bootstrap.cc:492] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.342306 24456 ts_tablet_manager.cc:1397] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.105s user 0.012s sys 0.010s
I20250109 21:11:25.345409 24459 tablet_bootstrap.cc:654] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.345144 24456 raft_consensus.cc:357] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.345917 24456 raft_consensus.cc:383] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.346235 24456 raft_consensus.cc:738] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.347616 24456 consensus_queue.cc:260] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.348994 24458 tablet_bootstrap.cc:492] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.349618 24458 ts_tablet_manager.cc:1397] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.018s user 0.010s sys 0.005s
I20250109 21:11:25.352341 24459 tablet_bootstrap.cc:492] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.352348 24456 ts_tablet_manager.cc:1428] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.010s user 0.004s sys 0.006s
I20250109 21:11:25.352819 24459 ts_tablet_manager.cc:1397] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.018s user 0.014s sys 0.000s
I20250109 21:11:25.353153 24291 heartbeater.cc:502] Master 127.19.136.254:46761 was elected leader, sending a full tablet report...
I20250109 21:11:25.353494 24456 tablet_bootstrap.cc:492] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.352813 24458 raft_consensus.cc:357] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.353865 24458 raft_consensus.cc:383] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250109 21:11:25.354144 24292 tablet.cc:2367] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4: Can't schedule compaction. Clean time has not been advanced past its initial value.
I20250109 21:11:25.354174 24458 raft_consensus.cc:738] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.355221 24458 consensus_queue.cc:260] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.355923 24459 raft_consensus.cc:357] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.356698 24459 raft_consensus.cc:383] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.356964 24459 raft_consensus.cc:738] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.358812 24367 heartbeater.cc:502] Master 127.19.136.254:46761 was elected leader, sending a full tablet report...
I20250109 21:11:25.359449 24458 ts_tablet_manager.cc:1428] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.009s user 0.010s sys 0.000s
I20250109 21:11:25.360493 24458 tablet_bootstrap.cc:492] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.361719 24456 tablet_bootstrap.cc:654] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.363035 24459 consensus_queue.cc:260] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.369920 24458 tablet_bootstrap.cc:654] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.375173 24441 heartbeater.cc:502] Master 127.19.136.254:46761 was elected leader, sending a full tablet report...
I20250109 21:11:25.375645 24459 ts_tablet_manager.cc:1428] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.022s user 0.011s sys 0.005s
I20250109 21:11:25.376674 24459 tablet_bootstrap.cc:492] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.378553 24458 tablet_bootstrap.cc:492] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.379135 24458 ts_tablet_manager.cc:1397] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.003s
I20250109 21:11:25.380956 24456 tablet_bootstrap.cc:492] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.381477 24456 ts_tablet_manager.cc:1397] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.028s user 0.007s sys 0.015s
I20250109 21:11:25.382251 24458 raft_consensus.cc:357] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.382987 24459 tablet_bootstrap.cc:654] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.383235 24458 raft_consensus.cc:383] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.383922 24458 raft_consensus.cc:738] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.384711 24458 consensus_queue.cc:260] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.385861 24456 raft_consensus.cc:357] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.386970 24456 raft_consensus.cc:383] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.387347 24456 raft_consensus.cc:738] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.387494 24458 ts_tablet_manager.cc:1428] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250109 21:11:25.388540 24458 tablet_bootstrap.cc:492] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.388351 24456 consensus_queue.cc:260] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.391819 24456 ts_tablet_manager.cc:1428] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.010s user 0.006s sys 0.003s
I20250109 21:11:25.392966 24456 tablet_bootstrap.cc:492] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.395793 24458 tablet_bootstrap.cc:654] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.401384 24456 tablet_bootstrap.cc:654] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.405474 24459 tablet_bootstrap.cc:492] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.406062 24459 ts_tablet_manager.cc:1397] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.030s user 0.004s sys 0.022s
I20250109 21:11:25.409440 24459 raft_consensus.cc:357] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.410408 24459 raft_consensus.cc:383] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.410775 24459 raft_consensus.cc:738] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.411607 24459 consensus_queue.cc:260] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.414425 24459 ts_tablet_manager.cc:1428] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.008s user 0.005s sys 0.004s
I20250109 21:11:25.415447 24459 tablet_bootstrap.cc:492] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.414469 24456 tablet_bootstrap.cc:492] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.419296 24456 ts_tablet_manager.cc:1397] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.027s user 0.007s sys 0.013s
I20250109 21:11:25.421798 24459 tablet_bootstrap.cc:654] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.422209 24456 raft_consensus.cc:357] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.423032 24456 raft_consensus.cc:383] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.423377 24456 raft_consensus.cc:738] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.424337 24458 tablet_bootstrap.cc:492] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.424228 24456 consensus_queue.cc:260] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.426668 24456 ts_tablet_manager.cc:1428] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20250109 21:11:25.424832 24458 ts_tablet_manager.cc:1397] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.036s user 0.019s sys 0.013s
I20250109 21:11:25.430011 24458 raft_consensus.cc:357] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.430483 24459 tablet_bootstrap.cc:492] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.430863 24458 raft_consensus.cc:383] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.431099 24459 ts_tablet_manager.cc:1397] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.016s user 0.012s sys 0.003s
I20250109 21:11:25.431183 24458 raft_consensus.cc:738] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.431990 24456 tablet_bootstrap.cc:492] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.432036 24458 consensus_queue.cc:260] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.433887 24459 raft_consensus.cc:357] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.434594 24459 raft_consensus.cc:383] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.434859 24459 raft_consensus.cc:738] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.435564 24459 consensus_queue.cc:260] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.437850 24459 ts_tablet_manager.cc:1428] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.006s user 0.004s sys 0.000s
I20250109 21:11:25.438719 24456 tablet_bootstrap.cc:654] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.438751 24459 tablet_bootstrap.cc:492] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.440727 24458 ts_tablet_manager.cc:1428] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.013s user 0.004s sys 0.002s
I20250109 21:11:25.444079 24458 tablet_bootstrap.cc:492] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.445238 24459 tablet_bootstrap.cc:654] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.450531 24458 tablet_bootstrap.cc:654] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.457414 24456 tablet_bootstrap.cc:492] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.458019 24456 ts_tablet_manager.cc:1397] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.026s user 0.011s sys 0.012s
I20250109 21:11:25.461498 24458 tablet_bootstrap.cc:492] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.461680 24459 tablet_bootstrap.cc:492] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.461246 24456 raft_consensus.cc:357] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.461951 24458 ts_tablet_manager.cc:1397] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.018s user 0.006s sys 0.005s
I20250109 21:11:25.462116 24459 ts_tablet_manager.cc:1397] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.008s
I20250109 21:11:25.462088 24456 raft_consensus.cc:383] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.462641 24456 raft_consensus.cc:738] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.463500 24456 consensus_queue.cc:260] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.464478 24459 raft_consensus.cc:357] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.465198 24459 raft_consensus.cc:383] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.464881 24458 raft_consensus.cc:357] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.465513 24459 raft_consensus.cc:738] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.465659 24458 raft_consensus.cc:383] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.466023 24458 raft_consensus.cc:738] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.466266 24456 ts_tablet_manager.cc:1428] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.008s user 0.005s sys 0.005s
I20250109 21:11:25.466277 24459 consensus_queue.cc:260] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.466780 24458 consensus_queue.cc:260] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.467334 24456 tablet_bootstrap.cc:492] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.468901 24459 ts_tablet_manager.cc:1428] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:11:25.469275 24458 ts_tablet_manager.cc:1428] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.007s user 0.002s sys 0.003s
I20250109 21:11:25.469863 24459 tablet_bootstrap.cc:492] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.470247 24458 tablet_bootstrap.cc:492] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.476248 24456 tablet_bootstrap.cc:654] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.476500 24459 tablet_bootstrap.cc:654] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.477067 24458 tablet_bootstrap.cc:654] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.489727 24456 tablet_bootstrap.cc:492] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.489732 24458 tablet_bootstrap.cc:492] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.490316 24458 ts_tablet_manager.cc:1397] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.020s user 0.016s sys 0.004s
I20250109 21:11:25.490316 24456 ts_tablet_manager.cc:1397] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.007s
I20250109 21:11:25.492120 24463 raft_consensus.cc:491] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.492632 24463 raft_consensus.cc:513] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.493568 24458 raft_consensus.cc:357] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.494349 24458 raft_consensus.cc:383] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.494650 24458 raft_consensus.cc:738] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.495853 24459 tablet_bootstrap.cc:492] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.496311 24459 ts_tablet_manager.cc:1397] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.027s user 0.009s sys 0.016s
I20250109 21:11:25.499509 24459 raft_consensus.cc:357] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.499552 24458 consensus_queue.cc:260] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.500651 24459 raft_consensus.cc:383] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.501075 24459 raft_consensus.cc:738] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.501112 24463 leader_election.cc:290] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.502657 24459 consensus_queue.cc:260] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.505398 24459 ts_tablet_manager.cc:1428] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250109 21:11:25.506353 24459 tablet_bootstrap.cc:492] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.508708 24456 raft_consensus.cc:357] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.509423 24456 raft_consensus.cc:383] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.509721 24456 raft_consensus.cc:738] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.510361 24458 ts_tablet_manager.cc:1428] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.020s user 0.010s sys 0.007s
I20250109 21:11:25.511682 24458 tablet_bootstrap.cc:492] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.512676 24459 tablet_bootstrap.cc:654] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.512916 24456 consensus_queue.cc:260] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.517016 24456 ts_tablet_manager.cc:1428] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.026s user 0.006s sys 0.000s
I20250109 21:11:25.518615 24458 tablet_bootstrap.cc:654] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.520483 24456 tablet_bootstrap.cc:492] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.521720 24462 raft_consensus.cc:491] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.522328 24462 raft_consensus.cc:513] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.525622 24464 raft_consensus.cc:491] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.526257 24464 raft_consensus.cc:513] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.574795 24464 leader_election.cc:290] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:25.586117 24458 tablet_bootstrap.cc:492] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.586936 24458 ts_tablet_manager.cc:1397] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.075s user 0.016s sys 0.022s
I20250109 21:11:25.591581 24482 raft_consensus.cc:491] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.596074 24479 raft_consensus.cc:491] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.597177 24479 raft_consensus.cc:513] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.600378 24456 tablet_bootstrap.cc:654] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.590036 24462 leader_election.cc:290] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.611388 24459 tablet_bootstrap.cc:492] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.611976 24459 ts_tablet_manager.cc:1397] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.106s user 0.051s sys 0.038s
I20250109 21:11:25.613765 24479 leader_election.cc:290] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.615070 24459 raft_consensus.cc:357] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.615937 24459 raft_consensus.cc:383] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.616226 24459 raft_consensus.cc:738] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.619158 24458 raft_consensus.cc:357] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.624389 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50630bfe825448bab1eaa3beb904b50b" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.622372 24458 raft_consensus.cc:383] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.628875 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.629010 24458 raft_consensus.cc:738] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.592305 24482 raft_consensus.cc:513] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.631094 24458 consensus_queue.cc:260] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.634091 24459 consensus_queue.cc:260] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.635440 24416 raft_consensus.cc:2463] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 0.
I20250109 21:11:25.636580 24458 ts_tablet_manager.cc:1428] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.049s user 0.004s sys 0.003s
I20250109 21:11:25.633554 24482 leader_election.cc:290] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.639536 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
W20250109 21:11:25.643071 24380 leader_election.cc:343] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.638088 24462 raft_consensus.cc:491] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.644232 24462 raft_consensus.cc:513] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.646054 24462 leader_election.cc:290] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
W20250109 21:11:25.637840 24306 leader_election.cc:343] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.650204 24306 leader_election.cc:304] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.650751 24459 ts_tablet_manager.cc:1428] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.038s user 0.006s sys 0.003s
I20250109 21:11:25.651172 24479 raft_consensus.cc:2798] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:25.651595 24479 raft_consensus.cc:491] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:25.651825 24459 tablet_bootstrap.cc:492] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.651947 24479 raft_consensus.cc:3054] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.656396 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50630bfe825448bab1eaa3beb904b50b" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:25.656841 24458 tablet_bootstrap.cc:492] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.656908 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:25.657773 24265 raft_consensus.cc:2463] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 0.
W20250109 21:11:25.664346 24305 leader_election.cc:343] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.664393 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:25.665194 24458 tablet_bootstrap.cc:654] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.665212 24305 leader_election.cc:304] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:25.665416 24341 raft_consensus.cc:2463] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:25.666513 24463 raft_consensus.cc:2743] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:25.667598 24381 leader_election.cc:304] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:25.669052 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.669739 24416 raft_consensus.cc:2463] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:25.670933 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.671790 24415 raft_consensus.cc:2463] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:25.670851 24464 raft_consensus.cc:2798] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:25.672525 24464 raft_consensus.cc:491] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:25.671218 24479 raft_consensus.cc:513] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.673786 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.674460 24415 raft_consensus.cc:2463] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:25.675288 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:25.675813 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:25.675976 24479 leader_election.cc:290] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.676633 24340 raft_consensus.cc:2388] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47125da93b0e4ef8b9e12cd10cd123b4 in current term 1: Already voted for candidate 31e6940413e84966ab39625aa5d4ccc5 in this term.
I20250109 21:11:25.673347 24459 tablet_bootstrap.cc:654] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.677105 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:25.673957 24456 tablet_bootstrap.cc:492] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.672890 24464 raft_consensus.cc:3054] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.677245 24231 leader_election.cc:304] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.678542 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:25.678969 24462 raft_consensus.cc:2798] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:25.679533 24462 raft_consensus.cc:491] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:25.679965 24462 raft_consensus.cc:3054] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.681511 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:25.682291 24415 raft_consensus.cc:3054] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.688640 24479 raft_consensus.cc:491] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:11:25.690145 24212 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:11:25.690018 24231 leader_election.cc:304] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.690846 24265 raft_consensus.cc:3054] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.689317 24479 raft_consensus.cc:513] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.698983 24462 raft_consensus.cc:513] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.703929 24464 raft_consensus.cc:513] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.705642 24231 leader_election.cc:304] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.708514 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.709200 24479 leader_election.cc:290] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
W20250109 21:11:25.712693 24306 leader_election.cc:343] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.701689 24462 leader_election.cc:290] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.713786 24462 raft_consensus.cc:2798] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:25.714126 24462 raft_consensus.cc:491] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:25.714476 24462 raft_consensus.cc:3054] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.715024 24459 tablet_bootstrap.cc:492] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.715330 24265 raft_consensus.cc:2463] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 1.
I20250109 21:11:25.715590 24459 ts_tablet_manager.cc:1397] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.064s user 0.018s sys 0.021s
I20250109 21:11:25.715680 24479 raft_consensus.cc:491] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.715894 24482 raft_consensus.cc:2758] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20250109 21:11:25.716410 24479 raft_consensus.cc:513] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.719417 24479 leader_election.cc:290] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.719686 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.719777 24459 raft_consensus.cc:357] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.720464 24416 raft_consensus.cc:2463] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 0.
I20250109 21:11:25.720570 24459 raft_consensus.cc:383] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.720949 24459 raft_consensus.cc:738] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.721716 24306 leader_election.cc:304] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.722647 24479 raft_consensus.cc:2798] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:25.721935 24459 consensus_queue.cc:260] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.723161 24479 raft_consensus.cc:491] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:25.723601 24479 raft_consensus.cc:3054] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.712618 24415 raft_consensus.cc:2463] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 1.
I20250109 21:11:25.723953 24462 raft_consensus.cc:513] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.725394 24306 leader_election.cc:304] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.725920 24462 leader_election.cc:290] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.726451 24463 raft_consensus.cc:2798] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:25.710633 24456 ts_tablet_manager.cc:1397] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.193s user 0.009s sys 0.017s
I20250109 21:11:25.728868 24458 tablet_bootstrap.cc:492] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.733098 24458 ts_tablet_manager.cc:1397] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.076s user 0.014s sys 0.037s
I20250109 21:11:25.729992 24456 raft_consensus.cc:357] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.735016 24456 raft_consensus.cc:383] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.735325 24456 raft_consensus.cc:738] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.736053 24456 consensus_queue.cc:260] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.736150 24458 raft_consensus.cc:357] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.737025 24458 raft_consensus.cc:383] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.737385 24458 raft_consensus.cc:738] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.738507 24456 ts_tablet_manager.cc:1428] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.011s user 0.005s sys 0.001s
I20250109 21:11:25.732436 24459 ts_tablet_manager.cc:1428] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.016s user 0.013s sys 0.000s
I20250109 21:11:25.732127 24479 raft_consensus.cc:513] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.739116 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:25.739758 24459 tablet_bootstrap.cc:492] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.739779 24340 raft_consensus.cc:3054] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.741789 24479 leader_election.cc:290] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.738277 24458 consensus_queue.cc:260] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.744525 24458 ts_tablet_manager.cc:1428] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.011s user 0.005s sys 0.000s
I20250109 21:11:25.744819 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:25.745500 24265 raft_consensus.cc:3054] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.745977 24458 tablet_bootstrap.cc:492] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.746402 24456 tablet_bootstrap.cc:492] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.751870 24459 tablet_bootstrap.cc:654] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.750787 24340 raft_consensus.cc:2463] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:25.752328 24265 raft_consensus.cc:2463] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:25.753368 24381 leader_election.cc:304] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.754484 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:25.755124 24415 raft_consensus.cc:3054] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.755434 24458 tablet_bootstrap.cc:654] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.755854 24494 raft_consensus.cc:2798] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:25.757450 24464 leader_election.cc:290] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:25.758636 24456 tablet_bootstrap.cc:654] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.765352 24415 raft_consensus.cc:2463] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 1.
I20250109 21:11:25.766713 24306 leader_election.cc:304] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.767540 24463 raft_consensus.cc:695] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:25.768153 24495 raft_consensus.cc:2798] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:25.768751 24495 raft_consensus.cc:695] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:25.768489 24463 consensus_queue.cc:237] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.769583 24495 consensus_queue.cc:237] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.777956 24494 raft_consensus.cc:695] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:25.779037 24494 consensus_queue.cc:237] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.787050 24456 tablet_bootstrap.cc:492] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.787784 24456 ts_tablet_manager.cc:1397] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.042s user 0.019s sys 0.003s
I20250109 21:11:25.788991 24160 catalog_manager.cc:5526] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:25.791256 24459 tablet_bootstrap.cc:492] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.791884 24459 ts_tablet_manager.cc:1397] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.052s user 0.019s sys 0.006s
I20250109 21:11:25.793666 24493 raft_consensus.cc:491] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.794198 24493 raft_consensus.cc:513] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.795456 24459 raft_consensus.cc:357] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.796408 24493 leader_election.cc:290] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
W20250109 21:11:25.794474 24231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:34483, user_credentials={real_user=slave}} blocked reactor thread for 88952us
I20250109 21:11:25.799206 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:25.799836 24341 raft_consensus.cc:3054] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.799265 24456 raft_consensus.cc:357] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.800339 24456 raft_consensus.cc:383] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.799696 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:25.800745 24456 raft_consensus.cc:738] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.801066 24416 raft_consensus.cc:3054] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.796451 24459 raft_consensus.cc:383] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.801932 24459 raft_consensus.cc:738] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.802764 24459 consensus_queue.cc:260] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.806077 24459 ts_tablet_manager.cc:1428] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.014s user 0.005s sys 0.003s
I20250109 21:11:25.807294 24459 tablet_bootstrap.cc:492] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:25.808015 24341 raft_consensus.cc:2463] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:25.810796 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f608b6f2484784be332e75fc641b47" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:25.810884 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:25.811501 24414 raft_consensus.cc:3054] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:11:25.812269 24231 leader_election.cc:343] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:25.813756 24231 leader_election.cc:343] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.814031 24459 tablet_bootstrap.cc:654] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.814623 24231 leader_election.cc:304] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:25.815508 24413 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f608b6f2484784be332e75fc641b47" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.815321 24456 consensus_queue.cc:260] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.816519 24413 raft_consensus.cc:2463] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:25.818481 24493 raft_consensus.cc:2798] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:25.818858 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:25.819020 24493 raft_consensus.cc:695] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:25.820744 24456 ts_tablet_manager.cc:1428] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.033s user 0.008s sys 0.001s
W20250109 21:11:25.820760 24231 leader_election.cc:343] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.820706 24493 consensus_queue.cc:237] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
W20250109 21:11:25.821815 24231 leader_election.cc:343] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.822161 24456 tablet_bootstrap.cc:492] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.824705 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:25.825794 24265 raft_consensus.cc:2463] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 0.
I20250109 21:11:25.827785 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:25.831054 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:25.831542 24305 leader_election.cc:304] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:25.832886 24456 tablet_bootstrap.cc:654] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.833125 24463 raft_consensus.cc:2798] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:25.831008 24416 raft_consensus.cc:2463] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:25.833658 24463 raft_consensus.cc:491] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:25.834019 24463 raft_consensus.cc:3054] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.840270 24414 raft_consensus.cc:2463] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:25.842777 24463 raft_consensus.cc:513] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.846405 24463 leader_election.cc:290] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
W20250109 21:11:25.847024 24305 leader_election.cc:343] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.846719 24231 leader_election.cc:304] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:25.849462 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:25.851449 24231 leader_election.cc:304] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
W20250109 21:11:25.851549 24306 leader_election.cc:343] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.852360 24493 raft_consensus.cc:2798] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:25.852859 24493 raft_consensus.cc:491] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:25.853250 24493 raft_consensus.cc:3054] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.853436 24462 raft_consensus.cc:2798] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election won for term 1
W20250109 21:11:25.853647 24305 leader_election.cc:343] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:25.853999 24462 raft_consensus.cc:695] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:25.854827 24462 consensus_queue.cc:237] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.855551 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:25.856195 24265 raft_consensus.cc:3054] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.857376 24463 raft_consensus.cc:491] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.857872 24463 raft_consensus.cc:513] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.862372 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:25.862507 24463 leader_election.cc:290] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.863047 24266 raft_consensus.cc:2463] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 0.
I20250109 21:11:25.863711 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:25.864034 24305 leader_election.cc:304] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:25.864526 24415 raft_consensus.cc:2463] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 0.
I20250109 21:11:25.865192 24463 raft_consensus.cc:2798] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:25.865665 24463 raft_consensus.cc:491] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:25.866046 24463 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.871666 24159 catalog_manager.cc:5526] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 1 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:25.873279 24265 raft_consensus.cc:2463] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 1.
I20250109 21:11:25.874454 24305 leader_election.cc:304] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:25.875615 24495 raft_consensus.cc:2798] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:25.876112 24495 raft_consensus.cc:695] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:25.876932 24495 consensus_queue.cc:237] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.871673 24458 tablet_bootstrap.cc:492] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.879571 24459 tablet_bootstrap.cc:492] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:25.880496 24459 ts_tablet_manager.cc:1397] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.073s user 0.002s sys 0.012s
I20250109 21:11:25.880545 24458 ts_tablet_manager.cc:1397] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.135s user 0.044s sys 0.049s
I20250109 21:11:25.881618 24456 tablet_bootstrap.cc:492] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.881984 24456 ts_tablet_manager.cc:1397] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.060s user 0.012s sys 0.008s
I20250109 21:11:25.885937 24458 raft_consensus.cc:357] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.886831 24458 raft_consensus.cc:383] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.886621 24493 raft_consensus.cc:513] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.887161 24458 raft_consensus.cc:738] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.879423 24162 catalog_manager.cc:5526] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:25.887858 24458 consensus_queue.cc:260] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.889662 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f608b6f2484784be332e75fc641b47" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:25.890112 24458 ts_tablet_manager.cc:1428] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.009s user 0.004s sys 0.000s
I20250109 21:11:25.890285 24415 raft_consensus.cc:3054] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.891005 24458 tablet_bootstrap.cc:492] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:25.892346 24459 raft_consensus.cc:357] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.893045 24459 raft_consensus.cc:383] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.893306 24459 raft_consensus.cc:738] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.893941 24459 consensus_queue.cc:260] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.896054 24459 ts_tablet_manager.cc:1428] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.015s user 0.005s sys 0.001s
I20250109 21:11:25.896622 24458 tablet_bootstrap.cc:654] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.897606 24415 raft_consensus.cc:2463] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:25.902344 24231 leader_election.cc:304] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:25.902738 24456 raft_consensus.cc:357] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.903314 24462 raft_consensus.cc:2798] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:25.903565 24456 raft_consensus.cc:383] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.903882 24456 raft_consensus.cc:738] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.904021 24462 raft_consensus.cc:695] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:25.905740 24456 consensus_queue.cc:260] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.906997 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f608b6f2484784be332e75fc641b47" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:25.906939 24462 consensus_queue.cc:237] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:25.907719 24340 raft_consensus.cc:3054] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.876925 24463 raft_consensus.cc:513] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.915815 24458 tablet_bootstrap.cc:492] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:25.916463 24458 ts_tablet_manager.cc:1397] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.026s user 0.007s sys 0.003s
I20250109 21:11:25.928443 24463 leader_election.cc:290] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:25.905151 24493 leader_election.cc:290] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Requested vote from peers 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:25.929500 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:25.931254 24340 raft_consensus.cc:2463] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:25.931718 24265 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.931793 24456 ts_tablet_manager.cc:1428] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.050s user 0.007s sys 0.000s
I20250109 21:11:25.933123 24456 tablet_bootstrap.cc:492] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:25.935710 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:25.937747 24415 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.940387 24265 raft_consensus.cc:2463] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 1.
I20250109 21:11:25.940999 24456 tablet_bootstrap.cc:654] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:25.943428 24305 leader_election.cc:304] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:25.944407 24495 raft_consensus.cc:2798] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:25.945122 24495 raft_consensus.cc:695] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:25.946024 24495 consensus_queue.cc:237] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.948858 24415 raft_consensus.cc:2463] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 1.
I20250109 21:11:25.952001 24159 catalog_manager.cc:5526] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:25.961808 24494 raft_consensus.cc:491] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:25.962499 24494 raft_consensus.cc:513] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.954505 24159 catalog_manager.cc:5526] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:25.966567 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:25.967098 24458 raft_consensus.cc:357] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.968089 24458 raft_consensus.cc:383] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.968518 24458 raft_consensus.cc:738] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.969295 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:25.969569 24458 consensus_queue.cc:260] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.970400 24265 raft_consensus.cc:2388] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90c75ac1abda40fd952cb7d88c7d753f in current term 1: Already voted for candidate 31e6940413e84966ab39625aa5d4ccc5 in this term.
I20250109 21:11:25.973362 24458 ts_tablet_manager.cc:1428] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.057s user 0.006s sys 0.002s
I20250109 21:11:25.975973 24494 leader_election.cc:290] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:25.977321 24381 leader_election.cc:304] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:25.978253 24494 raft_consensus.cc:3054] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:25.979933 24456 tablet_bootstrap.cc:492] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:25.980357 24456 ts_tablet_manager.cc:1397] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.047s user 0.020s sys 0.022s
I20250109 21:11:25.982604 24456 raft_consensus.cc:357] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.983366 24456 raft_consensus.cc:383] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:25.983642 24456 raft_consensus.cc:738] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:25.984272 24456 consensus_queue.cc:260] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:25.985744 24494 raft_consensus.cc:2743] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:25.986474 24456 ts_tablet_manager.cc:1428] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:11:25.985023 24162 catalog_manager.cc:5526] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:25.988075 24162 catalog_manager.cc:5526] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:26.004202 24159 catalog_manager.cc:5526] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:26.117938 24494 raft_consensus.cc:491] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:26.118501 24494 raft_consensus.cc:513] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.120167 24494 leader_election.cc:290] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:26.120959 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50630bfe825448bab1eaa3beb904b50b" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:26.121181 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50630bfe825448bab1eaa3beb904b50b" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:26.121570 24265 raft_consensus.cc:2463] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:26.121778 24340 raft_consensus.cc:2463] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:26.122521 24380 leader_election.cc:304] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:26.123402 24494 raft_consensus.cc:2798] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:26.123657 24494 raft_consensus.cc:491] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:26.123901 24494 raft_consensus.cc:3054] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:26.128537 24494 raft_consensus.cc:513] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.130110 24494 leader_election.cc:290] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:26.130898 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50630bfe825448bab1eaa3beb904b50b" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:26.131075 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50630bfe825448bab1eaa3beb904b50b" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:26.131445 24265 raft_consensus.cc:3054] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:26.131660 24340 raft_consensus.cc:3054] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:26.136233 24265 raft_consensus.cc:2463] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:26.136314 24340 raft_consensus.cc:2463] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:26.137120 24380 leader_election.cc:304] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:26.137821 24494 raft_consensus.cc:2798] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:26.138255 24494 raft_consensus.cc:695] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:26.139019 24494 consensus_queue.cc:237] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.145474 24159 catalog_manager.cc:5526] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 1 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:26.164669 24265 raft_consensus.cc:3054] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:26.170814 24495 consensus_queue.cc:1035] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.181308 24463 consensus_queue.cc:1035] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.220391 24493 consensus_queue.cc:1035] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.229758 24482 consensus_queue.cc:1035] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.270956 24463 consensus_queue.cc:1035] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.277781 24340 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
mode: GRACEFUL
new_leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:34890
I20250109 21:11:26.278512 24340 raft_consensus.cc:604] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Received request to transfer leadership to TS 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:26.281549 24495 consensus_queue.cc:1035] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.285023 24340 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
mode: GRACEFUL
new_leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:34890
I20250109 21:11:26.285678 24340 raft_consensus.cc:604] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Received request to transfer leadership to TS 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:26.289209 24495 raft_consensus.cc:988] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5: : Instructing follower 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:26.289841 24495 raft_consensus.cc:1076] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Signalling peer 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:26.292038 24265 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:35808
I20250109 21:11:26.292363 24340 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "98a0770c333f4e0881b843f212d91888"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
mode: GRACEFUL
new_leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:34890
I20250109 21:11:26.292805 24265 raft_consensus.cc:491] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:26.293072 24340 raft_consensus.cc:604] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Received request to transfer leadership to TS 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:26.293362 24265 raft_consensus.cc:3054] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.302965 24265 raft_consensus.cc:513] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.304949 24265 leader_election.cc:290] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:26.305907 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:26.306440 24340 raft_consensus.cc:3049] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:26.306701 24340 raft_consensus.cc:738] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:26.307353 24340 consensus_queue.cc:260] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.308964 24340 raft_consensus.cc:3054] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.309434 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:26.309975 24415 raft_consensus.cc:3054] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.311715 24265 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
mode: GRACEFUL
new_leader_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:35834
I20250109 21:11:26.312345 24265 raft_consensus.cc:604] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Received request to transfer leadership to TS 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:26.315593 24340 raft_consensus.cc:2463] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:26.315621 24415 raft_consensus.cc:2463] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:26.318426 24231 leader_election.cc:304] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:26.319116 24482 raft_consensus.cc:2798] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:26.319576 24482 raft_consensus.cc:695] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:26.320325 24482 consensus_queue.cc:237] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.323467 24265 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
mode: GRACEFUL
new_leader_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:35834
I20250109 21:11:26.324086 24265 raft_consensus.cc:604] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Received request to transfer leadership to TS 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:26.327236 24159 catalog_manager.cc:5526] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 1 to 2, leader changed from 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194) to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:26.338707 24415 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
mode: GRACEFUL
new_leader_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:50474
I20250109 21:11:26.339236 24415 raft_consensus.cc:604] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Received request to transfer leadership to TS 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:26.343464 24479 consensus_queue.cc:1035] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.353093 24463 consensus_queue.cc:1035] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.360967 24463 raft_consensus.cc:988] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5: : Instructing follower 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:26.360857 24494 consensus_queue.cc:1035] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.361668 24495 raft_consensus.cc:1076] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Signalling peer 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:26.363307 24265 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:35808
I20250109 21:11:26.363916 24265 raft_consensus.cc:491] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:26.364274 24265 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.372644 24531 consensus_queue.cc:1035] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:26.373235 24265 raft_consensus.cc:513] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.374071 24494 raft_consensus.cc:988] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f: : Instructing follower 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:26.374563 24494 raft_consensus.cc:1076] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Signalling peer 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:26.378038 24265 leader_election.cc:290] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:26.378598 24341 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:34878
I20250109 21:11:26.379199 24341 raft_consensus.cc:491] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:26.379511 24341 raft_consensus.cc:3054] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.380251 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:26.380889 24340 raft_consensus.cc:3049] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:26.380863 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:26.381548 24415 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.385157 24531 raft_consensus.cc:491] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:26.385596 24341 raft_consensus.cc:513] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.385772 24531 raft_consensus.cc:513] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.389039 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:26.390033 24482 consensus_queue.cc:1035] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:26.391692 24531 leader_election.cc:290] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:26.391906 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:26.392728 24414 raft_consensus.cc:2388] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31e6940413e84966ab39625aa5d4ccc5 in current term 1: Already voted for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in this term.
I20250109 21:11:26.394626 24306 leader_election.cc:304] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:26.395718 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:26.396401 24264 raft_consensus.cc:3054] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.398618 24340 raft_consensus.cc:738] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:26.395790 24463 raft_consensus.cc:3054] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:26.400420 24340 consensus_queue.cc:260] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.403606 24415 raft_consensus.cc:2463] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:26.405365 24340 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.407274 24231 leader_election.cc:304] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:26.411123 24482 raft_consensus.cc:2798] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:26.411573 24482 raft_consensus.cc:695] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:26.412286 24482 consensus_queue.cc:237] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.415581 24340 raft_consensus.cc:2463] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:26.422070 24462 consensus_queue.cc:1035] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:26.427466 24341 leader_election.cc:290] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:26.424633 24264 raft_consensus.cc:2463] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:26.428499 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:26.429266 24265 raft_consensus.cc:1235] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Rejecting Update request from peer 90c75ac1abda40fd952cb7d88c7d753f for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:26.432698 24414 raft_consensus.cc:3049] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:26.433168 24414 raft_consensus.cc:738] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:26.433688 24305 leader_election.cc:304] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:26.422806 24463 raft_consensus.cc:2743] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:26.434046 24414 consensus_queue.cc:260] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.434846 24495 raft_consensus.cc:2798] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:26.435444 24414 raft_consensus.cc:3054] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.440376 24479 consensus_queue.cc:1035] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.447995 24414 raft_consensus.cc:2463] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:26.449294 24462 consensus_queue.cc:1035] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:26.447675 24160 catalog_manager.cc:5526] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 1 to 2, leader changed from 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194) to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:26.450784 24495 raft_consensus.cc:695] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:26.451782 24495 consensus_queue.cc:237] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.459610 24462 raft_consensus.cc:988] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4: : Instructing follower 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:26.460024 24462 raft_consensus.cc:1076] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Signalling peer 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:26.463084 24340 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:34888
I20250109 21:11:26.464390 24340 raft_consensus.cc:491] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:26.464772 24340 raft_consensus.cc:3054] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.465301 24159 catalog_manager.cc:5526] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 1 to 2, leader changed from 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195) to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
W20250109 21:11:26.435263 24535 consensus_queue.cc:1159] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" responder_term: 2 status { last_received { term: 0 index: 0 } last_committed_idx: 0 error { code: INVALID_TERM status { code: ILLEGAL_STATE message: "Rejecting Update request from peer 90c75ac1abda40fd952cb7d88c7d753f for earlier term 1. Current term is 2. Ops: []" } } last_received_current_leader { term: 0 index: 0 } }
I20250109 21:11:26.472364 24462 consensus_queue.cc:1035] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:26.472064 24340 raft_consensus.cc:513] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.476976 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:26.477584 24265 raft_consensus.cc:3049] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:26.477893 24265 raft_consensus.cc:738] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:26.478785 24265 consensus_queue.cc:260] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.480038 24265 raft_consensus.cc:3054] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.481273 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:26.489502 24340 leader_election.cc:290] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:26.493079 24265 raft_consensus.cc:2463] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:26.494110 24305 leader_election.cc:304] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:26.494756 24495 raft_consensus.cc:2798] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:26.495213 24495 raft_consensus.cc:695] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:26.495939 24495 consensus_queue.cc:237] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.501498 24160 catalog_manager.cc:5526] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 1 to 2, leader changed from 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193) to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:26.606470 24535 consensus_queue.cc:1035] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.616216 24535 consensus_queue.cc:1035] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:26.668452 24495 raft_consensus.cc:988] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5: : Instructing follower 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:26.668898 24538 raft_consensus.cc:1076] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Signalling peer 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:26.670492 24265 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "98a0770c333f4e0881b843f212d91888"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:35808
I20250109 21:11:26.671159 24265 raft_consensus.cc:491] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:26.671471 24265 raft_consensus.cc:3054] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.676339 24265 raft_consensus.cc:513] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.677783 24265 leader_election.cc:290] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:26.678532 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:26.678731 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:26.679210 24340 raft_consensus.cc:3049] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:26.679278 24415 raft_consensus.cc:3054] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.679505 24340 raft_consensus.cc:738] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:26.680163 24340 consensus_queue.cc:260] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.681139 24340 raft_consensus.cc:3054] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.684345 24415 raft_consensus.cc:2463] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:26.685410 24231 leader_election.cc:304] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:26.685894 24340 raft_consensus.cc:2463] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:26.686072 24462 raft_consensus.cc:2798] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:26.686637 24462 raft_consensus.cc:695] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:26.687448 24462 consensus_queue.cc:237] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.694470 24160 catalog_manager.cc:5526] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 1 to 2, leader changed from 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194) to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:26.730932 24340 raft_consensus.cc:1270] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:26.732141 24462 consensus_queue.cc:1035] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:26.739148 24415 raft_consensus.cc:1270] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:26.741499 24493 consensus_queue.cc:1035] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:26.796566 24415 raft_consensus.cc:1270] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:26.797777 24493 consensus_queue.cc:1035] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:26.805135 24340 raft_consensus.cc:1270] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:26.807219 24482 consensus_queue.cc:1035] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:26.838936 24493 raft_consensus.cc:988] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4: : Instructing follower 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:26.839489 24482 raft_consensus.cc:1076] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Signalling peer 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:26.841243 24340 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:34888
I20250109 21:11:26.841866 24340 raft_consensus.cc:491] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:26.842159 24340 raft_consensus.cc:3054] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.849105 24340 raft_consensus.cc:513] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.850971 24340 leader_election.cc:290] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:26.852121 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:26.852823 24265 raft_consensus.cc:3049] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:26.852890 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:26.853219 24265 raft_consensus.cc:738] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:26.853552 24415 raft_consensus.cc:3054] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.854017 24265 consensus_queue.cc:260] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.855387 24265 raft_consensus.cc:3054] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.860670 24415 raft_consensus.cc:2463] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:26.861784 24306 leader_election.cc:304] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:26.862061 24265 raft_consensus.cc:2463] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:26.862432 24538 raft_consensus.cc:2798] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:26.862886 24538 raft_consensus.cc:695] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:26.863680 24538 consensus_queue.cc:237] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:26.869822 24161 catalog_manager.cc:5526] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 1 to 2, leader changed from 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193) to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:26.907994 24265 raft_consensus.cc:1270] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:26.909122 24538 consensus_queue.cc:1035] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:26.915794 24415 raft_consensus.cc:3054] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:26.922052 24415 raft_consensus.cc:1270] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:26.923208 24538 consensus_queue.cc:1035] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:26.994230 24265 raft_consensus.cc:1270] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 0 index: 0. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:26.995397 24538 consensus_queue.cc:1035] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:27.004227 24415 raft_consensus.cc:1270] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:27.005766 24538 consensus_queue.cc:1035] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:27.187564 24340 raft_consensus.cc:1270] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:27.188767 24462 consensus_queue.cc:1035] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:27.196395 24415 raft_consensus.cc:1270] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:27.198022 24482 consensus_queue.cc:1035] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:27.368059 24415 raft_consensus.cc:1270] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:27.369185 24538 consensus_queue.cc:1035] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:27.377512 24265 raft_consensus.cc:1270] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:27.379119 24495 consensus_queue.cc:1035] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:29.343367 20003 test_util.cc:274] Using random seed: 1811570517
I20250109 21:11:29.370584 24160 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:48582:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250109 21:11:29.373157 24160 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250109 21:11:29.423298 24248 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6de8b7d8c94a9e961d7e1378867508 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:29.423811 24327 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6de8b7d8c94a9e961d7e1378867508 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:29.424616 24248 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6de8b7d8c94a9e961d7e1378867508. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.424466 24401 tablet_service.cc:1467] Processing CreateTablet for tablet 5d6de8b7d8c94a9e961d7e1378867508 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:29.425050 24327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6de8b7d8c94a9e961d7e1378867508. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.425674 24401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5d6de8b7d8c94a9e961d7e1378867508. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.428521 24253 tablet_service.cc:1467] Processing CreateTablet for tablet f578e2ab431947e0805d2c6967d43dc3 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:29.428865 24331 tablet_service.cc:1467] Processing CreateTablet for tablet f578e2ab431947e0805d2c6967d43dc3 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:29.429739 24253 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f578e2ab431947e0805d2c6967d43dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.429271 24406 tablet_service.cc:1467] Processing CreateTablet for tablet f578e2ab431947e0805d2c6967d43dc3 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:29.430033 24331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f578e2ab431947e0805d2c6967d43dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.430960 24406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f578e2ab431947e0805d2c6967d43dc3. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.436965 24255 tablet_service.cc:1467] Processing CreateTablet for tablet 8adff09d64b444eabbb6a7bd0f97de6a (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:29.438143 24255 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8adff09d64b444eabbb6a7bd0f97de6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.440305 24329 tablet_service.cc:1467] Processing CreateTablet for tablet 8adff09d64b444eabbb6a7bd0f97de6a (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:29.441536 24329 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8adff09d64b444eabbb6a7bd0f97de6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.449469 24398 tablet_service.cc:1467] Processing CreateTablet for tablet 8adff09d64b444eabbb6a7bd0f97de6a (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:29.450824 24398 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8adff09d64b444eabbb6a7bd0f97de6a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.463577 24249 tablet_service.cc:1467] Processing CreateTablet for tablet 2019fe427a7d4c7fb03282c91b0d7176 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:29.464932 24249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2019fe427a7d4c7fb03282c91b0d7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.465559 24325 tablet_service.cc:1467] Processing CreateTablet for tablet 2019fe427a7d4c7fb03282c91b0d7176 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:29.467051 24325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2019fe427a7d4c7fb03282c91b0d7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.468992 24251 tablet_service.cc:1467] Processing CreateTablet for tablet 38a1ab3bdf884c52923588d4425c6632 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:29.470192 24331 tablet_service.cc:1467] Processing CreateTablet for tablet 38a1ab3bdf884c52923588d4425c6632 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:29.471184 24331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a1ab3bdf884c52923588d4425c6632. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.472218 24404 tablet_service.cc:1467] Processing CreateTablet for tablet 2019fe427a7d4c7fb03282c91b0d7176 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:29.473459 24404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2019fe427a7d4c7fb03282c91b0d7176. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.473201 24256 tablet_service.cc:1467] Processing CreateTablet for tablet 7944e0ea090a460db2c4f7b3d6be4a35 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:29.476598 24400 tablet_service.cc:1467] Processing CreateTablet for tablet 38a1ab3bdf884c52923588d4425c6632 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:29.483430 24400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a1ab3bdf884c52923588d4425c6632. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.484050 24326 tablet_service.cc:1467] Processing CreateTablet for tablet 7944e0ea090a460db2c4f7b3d6be4a35 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:29.485296 24326 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7944e0ea090a460db2c4f7b3d6be4a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.487809 24256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7944e0ea090a460db2c4f7b3d6be4a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.491492 24251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 38a1ab3bdf884c52923588d4425c6632. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.497633 24563 tablet_bootstrap.cc:492] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:29.502562 24564 tablet_bootstrap.cc:492] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:29.505239 24563 tablet_bootstrap.cc:654] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.516214 24565 tablet_bootstrap.cc:492] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:29.525444 24565 tablet_bootstrap.cc:654] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.535494 24564 tablet_bootstrap.cc:654] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.551836 24400 tablet_service.cc:1467] Processing CreateTablet for tablet 7944e0ea090a460db2c4f7b3d6be4a35 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:29.554454 24400 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 7944e0ea090a460db2c4f7b3d6be4a35. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.554762 24251 tablet_service.cc:1467] Processing CreateTablet for tablet 1e6f26fa5c544ef7933cf72e192c178b (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:29.556124 24251 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6f26fa5c544ef7933cf72e192c178b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.558694 24331 tablet_service.cc:1467] Processing CreateTablet for tablet 1e6f26fa5c544ef7933cf72e192c178b (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:29.560359 24331 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6f26fa5c544ef7933cf72e192c178b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.560635 24563 tablet_bootstrap.cc:492] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:29.561210 24563 ts_tablet_manager.cc:1397] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.064s user 0.017s sys 0.028s
I20250109 21:11:29.561406 24406 tablet_service.cc:1467] Processing CreateTablet for tablet 1e6f26fa5c544ef7933cf72e192c178b (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:29.562675 24406 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 1e6f26fa5c544ef7933cf72e192c178b. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.563565 24404 tablet_service.cc:1467] Processing CreateTablet for tablet 2695abb92d0b4ffab484d8559954101a (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:29.562546 24249 tablet_service.cc:1467] Processing CreateTablet for tablet 2695abb92d0b4ffab484d8559954101a (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:29.564790 24404 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2695abb92d0b4ffab484d8559954101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.570307 24563 raft_consensus.cc:357] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.571166 24563 raft_consensus.cc:383] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.571491 24249 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2695abb92d0b4ffab484d8559954101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.574815 24325 tablet_service.cc:1467] Processing CreateTablet for tablet 2695abb92d0b4ffab484d8559954101a (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:29.578361 24256 tablet_service.cc:1467] Processing CreateTablet for tablet d58d0e7f91b54d7cbbdbb2dd51ae5c28 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:29.578984 24327 tablet_service.cc:1467] Processing CreateTablet for tablet d58d0e7f91b54d7cbbdbb2dd51ae5c28 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:29.580229 24325 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 2695abb92d0b4ffab484d8559954101a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.581008 24327 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58d0e7f91b54d7cbbdbb2dd51ae5c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.580229 24256 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58d0e7f91b54d7cbbdbb2dd51ae5c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.583333 24401 tablet_service.cc:1467] Processing CreateTablet for tablet d58d0e7f91b54d7cbbdbb2dd51ae5c28 (DEFAULT_TABLE table=soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:29.584533 24401 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet d58d0e7f91b54d7cbbdbb2dd51ae5c28. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:29.571460 24563 raft_consensus.cc:738] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.587564 24563 consensus_queue.cc:260] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.594882 24563 ts_tablet_manager.cc:1428] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.033s user 0.004s sys 0.004s
I20250109 21:11:29.604009 24563 tablet_bootstrap.cc:492] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:29.613101 24565 tablet_bootstrap.cc:492] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:29.613765 24565 ts_tablet_manager.cc:1397] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.098s user 0.016s sys 0.017s
I20250109 21:11:29.613925 24563 tablet_bootstrap.cc:654] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.616708 24565 raft_consensus.cc:357] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.636328 24565 raft_consensus.cc:383] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.636672 24565 raft_consensus.cc:738] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.637405 24565 consensus_queue.cc:260] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.639935 24565 ts_tablet_manager.cc:1428] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.026s user 0.003s sys 0.003s
I20250109 21:11:29.640899 24565 tablet_bootstrap.cc:492] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:29.647831 24565 tablet_bootstrap.cc:654] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.653512 24564 tablet_bootstrap.cc:492] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:29.654054 24564 ts_tablet_manager.cc:1397] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.152s user 0.022s sys 0.030s
I20250109 21:11:29.654837 24563 tablet_bootstrap.cc:492] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:29.655431 24563 ts_tablet_manager.cc:1397] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.052s user 0.013s sys 0.007s
I20250109 21:11:29.656703 24564 raft_consensus.cc:357] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.657501 24564 raft_consensus.cc:383] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.657820 24564 raft_consensus.cc:738] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.658495 24564 consensus_queue.cc:260] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.660389 24564 ts_tablet_manager.cc:1428] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.006s user 0.005s sys 0.000s
I20250109 21:11:29.661422 24564 tablet_bootstrap.cc:492] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:29.662463 24563 raft_consensus.cc:357] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.667583 24564 tablet_bootstrap.cc:654] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.663379 24563 raft_consensus.cc:383] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.668897 24563 raft_consensus.cc:738] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.669683 24563 consensus_queue.cc:260] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.672221 24563 ts_tablet_manager.cc:1428] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.016s user 0.001s sys 0.005s
I20250109 21:11:29.673691 24563 tablet_bootstrap.cc:492] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:29.679406 24565 tablet_bootstrap.cc:492] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:29.679916 24563 tablet_bootstrap.cc:654] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.679980 24565 ts_tablet_manager.cc:1397] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.039s user 0.011s sys 0.004s
I20250109 21:11:29.680013 24564 tablet_bootstrap.cc:492] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:29.680903 24564 ts_tablet_manager.cc:1397] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.020s user 0.017s sys 0.002s
I20250109 21:11:29.683668 24565 raft_consensus.cc:357] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.683727 24564 raft_consensus.cc:357] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.684645 24564 raft_consensus.cc:383] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.684564 24565 raft_consensus.cc:383] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.685132 24564 raft_consensus.cc:738] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.685240 24565 raft_consensus.cc:738] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.685966 24564 consensus_queue.cc:260] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.688333 24564 ts_tablet_manager.cc:1428] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:11:29.686437 24565 consensus_queue.cc:260] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.689174 24564 tablet_bootstrap.cc:492] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:29.692360 24551 raft_consensus.cc:491] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.692849 24551 raft_consensus.cc:513] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.693780 24563 tablet_bootstrap.cc:492] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:29.694245 24563 ts_tablet_manager.cc:1397] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.021s user 0.007s sys 0.008s
I20250109 21:11:29.694967 24551 leader_election.cc:290] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:29.695861 24564 tablet_bootstrap.cc:654] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.696496 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:29.696986 24563 raft_consensus.cc:357] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.697719 24563 raft_consensus.cc:383] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.698021 24563 raft_consensus.cc:738] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.698801 24563 consensus_queue.cc:260] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.701310 24563 ts_tablet_manager.cc:1428] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.007s user 0.006s sys 0.001s
I20250109 21:11:29.701718 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:29.702236 24265 raft_consensus.cc:2463] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 0.
W20250109 21:11:29.703496 24306 leader_election.cc:343] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:29.702893 24563 tablet_bootstrap.cc:492] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:29.705315 24305 leader_election.cc:304] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:29.709007 24551 raft_consensus.cc:2798] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:29.709432 24551 raft_consensus.cc:491] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:29.709836 24551 raft_consensus.cc:3054] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.714836 24563 tablet_bootstrap.cc:654] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.717360 24551 raft_consensus.cc:513] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.720184 24565 ts_tablet_manager.cc:1428] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.040s user 0.004s sys 0.003s
I20250109 21:11:29.723839 24565 tablet_bootstrap.cc:492] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:29.725277 24563 tablet_bootstrap.cc:492] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:29.725766 24563 ts_tablet_manager.cc:1397] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.023s user 0.011s sys 0.003s
I20250109 21:11:29.728426 24563 raft_consensus.cc:357] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.729120 24563 raft_consensus.cc:383] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.729410 24563 raft_consensus.cc:738] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
W20250109 21:11:29.729449 24212 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:11:29.730343 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:29.730142 24563 consensus_queue.cc:260] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.730878 24265 raft_consensus.cc:3054] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.735800 24563 ts_tablet_manager.cc:1428] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.010s user 0.007s sys 0.000s
I20250109 21:11:29.736793 24563 tablet_bootstrap.cc:492] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:29.737726 24265 raft_consensus.cc:2463] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 1.
I20250109 21:11:29.738804 24305 leader_election.cc:304] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:29.739688 24495 raft_consensus.cc:2798] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:29.743883 24563 tablet_bootstrap.cc:654] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.747260 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
W20250109 21:11:29.748980 24306 leader_election.cc:343] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:29.755347 24551 leader_election.cc:290] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:29.759842 24495 raft_consensus.cc:695] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:29.760388 24565 tablet_bootstrap.cc:654] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.761906 24564 tablet_bootstrap.cc:492] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:29.762630 24564 ts_tablet_manager.cc:1397] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.074s user 0.028s sys 0.041s
I20250109 21:11:29.764436 24549 raft_consensus.cc:491] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.764923 24549 raft_consensus.cc:513] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.765856 24564 raft_consensus.cc:357] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.766594 24564 raft_consensus.cc:383] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.766884 24564 raft_consensus.cc:738] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.767005 24549 leader_election.cc:290] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:29.767694 24564 consensus_queue.cc:260] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.768510 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:29.770431 24564 ts_tablet_manager.cc:1428] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
W20250109 21:11:29.771297 24381 leader_election.cc:343] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:29.771898 24563 tablet_bootstrap.cc:492] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:29.772140 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:29.772451 24563 ts_tablet_manager.cc:1397] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.036s user 0.019s sys 0.011s
W20250109 21:11:29.773310 24380 leader_election.cc:343] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:29.773765 24380 leader_election.cc:304] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:29.774937 24549 raft_consensus.cc:2743] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:29.775148 24564 tablet_bootstrap.cc:492] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:29.775496 24563 raft_consensus.cc:357] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.776333 24563 raft_consensus.cc:383] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.776674 24563 raft_consensus.cc:738] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.777487 24563 consensus_queue.cc:260] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.780025 24563 ts_tablet_manager.cc:1428] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:11:29.781170 24563 tablet_bootstrap.cc:492] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:29.782116 24564 tablet_bootstrap.cc:654] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.788650 24495 consensus_queue.cc:237] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.798867 24563 tablet_bootstrap.cc:654] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.805961 24564 tablet_bootstrap.cc:492] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:29.806571 24564 ts_tablet_manager.cc:1397] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.035s user 0.007s sys 0.023s
I20250109 21:11:29.807910 24563 tablet_bootstrap.cc:492] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:29.808429 24563 ts_tablet_manager.cc:1397] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.027s user 0.013s sys 0.002s
I20250109 21:11:29.809553 24564 raft_consensus.cc:357] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.810403 24564 raft_consensus.cc:383] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.807924 24161 catalog_manager.cc:5526] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 0 to 1, leader changed from <none> to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:29.810725 24564 raft_consensus.cc:738] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.811194 24563 raft_consensus.cc:357] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.811949 24563 raft_consensus.cc:383] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.812299 24563 raft_consensus.cc:738] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.811789 24564 consensus_queue.cc:260] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.813007 24563 consensus_queue.cc:260] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.815363 24563 ts_tablet_manager.cc:1428] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.007s user 0.008s sys 0.000s
I20250109 21:11:29.815788 24552 raft_consensus.cc:491] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.816255 24563 tablet_bootstrap.cc:492] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:29.816239 24552 raft_consensus.cc:513] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.818305 24552 leader_election.cc:290] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:29.822008 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:29.822571 24563 tablet_bootstrap.cc:654] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.823220 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
W20250109 21:11:29.823570 24231 leader_election.cc:343] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:29.823870 24415 raft_consensus.cc:2463] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:29.825117 24564 ts_tablet_manager.cc:1428] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.018s user 0.005s sys 0.001s
I20250109 21:11:29.826162 24564 tablet_bootstrap.cc:492] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:29.831259 24231 leader_election.cc:304] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:29.832374 24552 raft_consensus.cc:2798] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:29.832719 24552 raft_consensus.cc:491] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:29.833058 24552 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.834192 24564 tablet_bootstrap.cc:654] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.837548 24565 tablet_bootstrap.cc:492] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:29.837944 24565 ts_tablet_manager.cc:1397] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.114s user 0.010s sys 0.032s
I20250109 21:11:29.839386 24552 raft_consensus.cc:513] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.839761 24564 tablet_bootstrap.cc:492] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:29.840345 24564 ts_tablet_manager.cc:1397] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.014s user 0.012s sys 0.002s
I20250109 21:11:29.840677 24565 raft_consensus.cc:357] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.841517 24565 raft_consensus.cc:383] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.841859 24565 raft_consensus.cc:738] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.841791 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:29.841979 24563 tablet_bootstrap.cc:492] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:29.843488 24563 ts_tablet_manager.cc:1397] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.009s
I20250109 21:11:29.843189 24564 raft_consensus.cc:357] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.843883 24552 leader_election.cc:290] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:29.844013 24564 raft_consensus.cc:383] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.842877 24565 consensus_queue.cc:260] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.844206 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:29.844583 24564 raft_consensus.cc:738] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.844916 24415 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.845311 24564 consensus_queue.cc:260] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.846256 24340 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.846540 24565 ts_tablet_manager.cc:1428] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.008s user 0.002s sys 0.008s
I20250109 21:11:29.847571 24565 tablet_bootstrap.cc:492] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:29.847883 24564 ts_tablet_manager.cc:1428] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250109 21:11:29.848922 24564 tablet_bootstrap.cc:492] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:29.853139 24415 raft_consensus.cc:2463] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:29.853318 24549 raft_consensus.cc:491] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.856117 24549 raft_consensus.cc:513] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.856832 24231 leader_election.cc:304] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:29.857860 24552 raft_consensus.cc:2798] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:29.858371 24552 raft_consensus.cc:695] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:29.857992 24563 raft_consensus.cc:357] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.858841 24563 raft_consensus.cc:383] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.858901 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:29.859220 24563 raft_consensus.cc:738] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.859174 24552 consensus_queue.cc:237] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.859580 24265 raft_consensus.cc:2463] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:29.860085 24563 consensus_queue.cc:260] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.860594 24380 leader_election.cc:304] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:29.861145 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:29.861801 24339 raft_consensus.cc:2463] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:29.868607 24462 raft_consensus.cc:491] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.858089 24549 leader_election.cc:290] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:29.869297 24462 raft_consensus.cc:513] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.871073 24549 raft_consensus.cc:2798] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:29.871517 24549 raft_consensus.cc:491] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:29.871924 24549 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.872727 24462 leader_election.cc:290] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:29.854213 24565 tablet_bootstrap.cc:654] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.874881 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
W20250109 21:11:29.876700 24231 leader_election.cc:343] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:29.855083 24564 tablet_bootstrap.cc:654] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.895443 24565 tablet_bootstrap.cc:492] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:29.896070 24565 ts_tablet_manager.cc:1397] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.049s user 0.012s sys 0.003s
I20250109 21:11:29.899994 24340 raft_consensus.cc:2463] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:29.903164 24586 raft_consensus.cc:491] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.903685 24586 raft_consensus.cc:513] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.905478 24586 leader_election.cc:290] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:29.901146 24549 raft_consensus.cc:513] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.908550 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
W20250109 21:11:29.909991 24381 leader_election.cc:343] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:29.910183 24549 leader_election.cc:290] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
W20250109 21:11:29.907357 24380 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.193:42407, user_credentials={real_user=slave}} blocked reactor thread for 46850.5us
I20250109 21:11:29.911396 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:29.911742 24563 ts_tablet_manager.cc:1428] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.068s user 0.038s sys 0.013s
I20250109 21:11:29.912025 24339 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.913053 24563 tablet_bootstrap.cc:492] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:29.914685 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:29.915346 24415 raft_consensus.cc:2463] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:29.917352 24231 leader_election.cc:304] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:29.919317 24587 raft_consensus.cc:2798] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:29.920050 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:29.920285 24587 raft_consensus.cc:491] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:29.916450 24161 catalog_manager.cc:5526] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:29.920760 24587 raft_consensus.cc:3054] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.923264 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:29.923882 24266 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.928560 24587 raft_consensus.cc:513] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.930541 24587 leader_election.cc:290] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:29.931531 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:29.931836 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:29.932096 24415 raft_consensus.cc:3054] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:11:29.933332 24231 leader_election.cc:343] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:29.934183 24380 leader_election.cc:343] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:29.934773 24380 leader_election.cc:304] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:29.935739 24584 raft_consensus.cc:2743] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:29.937853 24563 tablet_bootstrap.cc:654] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.940121 24415 raft_consensus.cc:2463] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:29.940999 24565 raft_consensus.cc:357] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.941776 24565 raft_consensus.cc:383] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.942044 24565 raft_consensus.cc:738] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.942433 24231 leader_election.cc:304] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:29.942739 24565 consensus_queue.cc:260] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.944778 24565 ts_tablet_manager.cc:1428] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.048s user 0.005s sys 0.000s
I20250109 21:11:29.945631 24565 tablet_bootstrap.cc:492] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:29.945600 24587 raft_consensus.cc:2798] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:29.946492 24587 raft_consensus.cc:695] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:29.947604 24266 raft_consensus.cc:2463] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:29.947777 24587 consensus_queue.cc:237] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.949167 24380 leader_election.cc:304] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:29.949556 24339 raft_consensus.cc:2463] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:29.949971 24584 raft_consensus.cc:2798] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:29.950453 24584 raft_consensus.cc:695] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:29.951911 24584 consensus_queue.cc:237] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.954725 24565 tablet_bootstrap.cc:654] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.964496 24549 raft_consensus.cc:491] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.964872 24564 tablet_bootstrap.cc:492] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:29.965674 24564 ts_tablet_manager.cc:1397] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.117s user 0.004s sys 0.011s
I20250109 21:11:29.965190 24549 raft_consensus.cc:513] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.968575 24564 raft_consensus.cc:357] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.969393 24564 raft_consensus.cc:383] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:29.969218 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:29.969859 24564 raft_consensus.cc:738] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:29.970250 24339 raft_consensus.cc:2463] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:29.970968 24564 consensus_queue.cc:260] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.972208 24381 leader_election.cc:304] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:29.973487 24585 raft_consensus.cc:2798] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:29.973955 24585 raft_consensus.cc:491] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:29.974339 24585 raft_consensus.cc:3054] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:29.977116 24564 ts_tablet_manager.cc:1428] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.011s user 0.008s sys 0.000s
I20250109 21:11:29.978241 24564 tablet_bootstrap.cc:492] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:29.979574 24549 leader_election.cc:290] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:29.982582 24161 catalog_manager.cc:5526] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:29.984023 24587 raft_consensus.cc:491] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.989421 24565 tablet_bootstrap.cc:492] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:29.984815 24549 raft_consensus.cc:491] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:29.984459 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:29.987352 24563 tablet_bootstrap.cc:492] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:29.989928 24549 raft_consensus.cc:513] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.990434 24563 ts_tablet_manager.cc:1397] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.078s user 0.022s sys 0.023s
I20250109 21:11:29.987248 24160 catalog_manager.cc:5526] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 1 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:29.988174 24564 tablet_bootstrap.cc:654] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:29.989178 24587 raft_consensus.cc:513] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.993204 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:29.993408 24587 leader_election.cc:290] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:29.994117 24266 raft_consensus.cc:2463] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:29.991917 24549 leader_election.cc:290] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:29.986044 24585 raft_consensus.cc:513] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:29.997099 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:29.997221 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:29.997795 24339 raft_consensus.cc:2463] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:29.998404 24585 leader_election.cc:290] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:29.998711 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:29.999178 24565 ts_tablet_manager.cc:1397] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.054s user 0.013s sys 0.007s
I20250109 21:11:29.999089 24231 leader_election.cc:304] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:29.999022 24563 raft_consensus.cc:357] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.000869 24563 raft_consensus.cc:383] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.001209 24563 raft_consensus.cc:738] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.000725 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:30.001767 24265 raft_consensus.cc:3054] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.002023 24563 consensus_queue.cc:260] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.002221 24565 raft_consensus.cc:357] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.003293 24565 raft_consensus.cc:383] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.003635 24565 raft_consensus.cc:738] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.004487 24563 ts_tablet_manager.cc:1428] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.014s user 0.006s sys 0.000s
I20250109 21:11:30.005527 24587 raft_consensus.cc:491] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:30.006029 24587 raft_consensus.cc:513] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.005764 24563 tablet_bootstrap.cc:492] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f: Bootstrap starting.
I20250109 21:11:30.008174 24587 leader_election.cc:290] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.004323 24565 consensus_queue.cc:260] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.009721 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:30.010476 24565 ts_tablet_manager.cc:1428] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.011s user 0.006s sys 0.000s
I20250109 21:11:30.010409 24416 raft_consensus.cc:2463] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:29.999487 24415 raft_consensus.cc:2388] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47125da93b0e4ef8b9e12cd10cd123b4 in current term 1: Already voted for candidate 90c75ac1abda40fd952cb7d88c7d753f in this term.
I20250109 21:11:30.011107 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:30.001469 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:30.011765 24339 raft_consensus.cc:2463] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 0.
I20250109 21:11:30.012341 24266 raft_consensus.cc:2388] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 90c75ac1abda40fd952cb7d88c7d753f in current term 1: Already voted for candidate 31e6940413e84966ab39625aa5d4ccc5 in this term.
I20250109 21:11:30.012440 24565 tablet_bootstrap.cc:492] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:30.012833 24231 leader_election.cc:304] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:30.013645 24380 leader_election.cc:304] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:30.015048 24585 raft_consensus.cc:3054] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.013640 24552 raft_consensus.cc:2798] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:30.017084 24552 raft_consensus.cc:491] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:30.017529 24552 raft_consensus.cc:3054] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.019258 24565 tablet_bootstrap.cc:654] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:30.019948 24563 tablet_bootstrap.cc:654] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:30.022133 24564 tablet_bootstrap.cc:492] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:30.022692 24564 ts_tablet_manager.cc:1397] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.045s user 0.007s sys 0.011s
I20250109 21:11:30.024799 24565 tablet_bootstrap.cc:492] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:30.025272 24565 ts_tablet_manager.cc:1397] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.013s user 0.010s sys 0.001s
I20250109 21:11:30.025660 24564 raft_consensus.cc:357] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.026499 24564 raft_consensus.cc:383] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.026822 24564 raft_consensus.cc:738] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.027571 24564 consensus_queue.cc:260] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.028425 24565 raft_consensus.cc:357] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.029644 24565 raft_consensus.cc:383] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.030102 24564 ts_tablet_manager.cc:1428] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.007s user 0.005s sys 0.001s
I20250109 21:11:30.030027 24565 raft_consensus.cc:738] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.031443 24564 tablet_bootstrap.cc:492] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:30.031286 24565 consensus_queue.cc:260] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.033896 24565 ts_tablet_manager.cc:1428] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.008s user 0.006s sys 0.001s
I20250109 21:11:30.036381 24265 raft_consensus.cc:2463] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:30.036962 24587 raft_consensus.cc:2758] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20250109 21:11:30.037529 24380 leader_election.cc:304] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:30.038689 24564 tablet_bootstrap.cc:654] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:30.040174 24549 raft_consensus.cc:2798] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:30.040927 24549 raft_consensus.cc:695] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:30.042183 24549 consensus_queue.cc:237] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.047552 24565 tablet_bootstrap.cc:492] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:30.052878 24564 tablet_bootstrap.cc:492] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
I20250109 21:11:30.053377 24564 ts_tablet_manager.cc:1397] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.022s user 0.007s sys 0.010s
I20250109 21:11:30.056023 24564 raft_consensus.cc:357] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.060067 24564 raft_consensus.cc:383] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.060403 24564 raft_consensus.cc:738] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.061101 24564 consensus_queue.cc:260] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.063561 24564 ts_tablet_manager.cc:1428] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250109 21:11:30.064435 24564 tablet_bootstrap.cc:492] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4: Bootstrap starting.
I20250109 21:11:30.065014 24160 catalog_manager.cc:5526] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 1 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:30.065907 24565 tablet_bootstrap.cc:654] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:30.071154 24564 tablet_bootstrap.cc:654] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:30.055963 24585 raft_consensus.cc:2743] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:30.057525 24552 raft_consensus.cc:513] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.079211 24565 tablet_bootstrap.cc:492] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:30.080061 24565 ts_tablet_manager.cc:1397] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.033s user 0.007s sys 0.014s
I20250109 21:11:30.083930 24565 raft_consensus.cc:357] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.090314 24565 raft_consensus.cc:383] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.090713 24565 raft_consensus.cc:738] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.094692 24565 consensus_queue.cc:260] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.097749 24585 raft_consensus.cc:491] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:30.098160 24565 ts_tablet_manager.cc:1428] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.018s user 0.009s sys 0.000s
I20250109 21:11:30.098253 24585 raft_consensus.cc:513] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.099691 24565 tablet_bootstrap.cc:492] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:30.101091 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:30.101779 24265 raft_consensus.cc:2463] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:30.103009 24380 leader_election.cc:304] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:30.104077 24549 raft_consensus.cc:2798] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:30.104530 24549 raft_consensus.cc:491] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:30.104933 24549 raft_consensus.cc:3054] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.113554 24565 tablet_bootstrap.cc:654] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:30.118170 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:30.119010 24339 raft_consensus.cc:3054] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.128484 24552 leader_election.cc:290] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.128674 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:30.129482 24415 raft_consensus.cc:3054] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.130877 24339 raft_consensus.cc:2463] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:30.131788 24584 raft_consensus.cc:491] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:30.132252 24584 raft_consensus.cc:513] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.132426 24231 leader_election.cc:304] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:30.133550 24587 raft_consensus.cc:491] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:30.134079 24584 leader_election.cc:290] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:30.134097 24587 raft_consensus.cc:513] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.135767 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
W20250109 21:11:30.137226 24380 leader_election.cc:343] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:30.137702 24587 leader_election.cc:290] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.138439 24587 raft_consensus.cc:2798] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:30.138612 24549 raft_consensus.cc:513] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.140429 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:30.140515 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:30.142544 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:30.143959 24587 raft_consensus.cc:695] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
W20250109 21:11:30.144551 24381 leader_election.cc:343] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:30.145129 24587 consensus_queue.cc:237] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
W20250109 21:11:30.146085 24231 leader_election.cc:343] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483): Illegal state: must be running to vote when last-logged opid is not known
W20250109 21:11:30.151352 24231 leader_election.cc:343] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:30.151892 24231 leader_election.cc:304] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:30.152544 24415 raft_consensus.cc:2463] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 1.
I20250109 21:11:30.152904 24462 raft_consensus.cc:2743] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:30.154824 24565 tablet_bootstrap.cc:492] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:30.155519 24565 ts_tablet_manager.cc:1397] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.056s user 0.017s sys 0.004s
I20250109 21:11:30.158773 24565 raft_consensus.cc:357] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.159689 24565 raft_consensus.cc:383] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.160020 24565 raft_consensus.cc:738] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.160799 24565 consensus_queue.cc:260] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.164165 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:30.165084 24339 raft_consensus.cc:2463] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:30.166437 24381 leader_election.cc:304] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:30.167438 24584 raft_consensus.cc:2798] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:30.142220 24585 leader_election.cc:290] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:30.167793 24584 raft_consensus.cc:491] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:30.168192 24584 raft_consensus.cc:3054] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.175556 24565 ts_tablet_manager.cc:1428] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.020s user 0.007s sys 0.000s
I20250109 21:11:30.176851 24565 tablet_bootstrap.cc:492] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5: Bootstrap starting.
I20250109 21:11:30.177031 24161 catalog_manager.cc:5526] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:30.175624 24584 raft_consensus.cc:513] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.190929 24584 leader_election.cc:290] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:30.191267 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:30.192201 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:30.193120 24339 raft_consensus.cc:3054] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.195667 24495 raft_consensus.cc:491] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:30.196301 24495 raft_consensus.cc:513] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.194938 24549 leader_election.cc:290] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:30.199756 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:30.200996 24563 tablet_bootstrap.cc:492] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f: No bootstrap required, opened a new log
I20250109 21:11:30.201472 24563 ts_tablet_manager.cc:1397] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent bootstrapping tablet: real 0.196s user 0.056s sys 0.122s
I20250109 21:11:30.201754 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:30.202452 24415 raft_consensus.cc:2388] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31e6940413e84966ab39625aa5d4ccc5 in current term 1: Already voted for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in this term.
W20250109 21:11:30.192520 24380 leader_election.cc:343] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:30.203181 24564 tablet_bootstrap.cc:492] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4: No bootstrap required, opened a new log
W20250109 21:11:30.203433 24381 leader_election.cc:343] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:30.203783 24564 ts_tablet_manager.cc:1397] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent bootstrapping tablet: real 0.140s user 0.051s sys 0.051s
I20250109 21:11:30.199864 24495 leader_election.cc:290] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.204068 24563 raft_consensus.cc:357] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.204803 24563 raft_consensus.cc:383] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.204337 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:30.205077 24563 raft_consensus.cc:738] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.205312 24265 raft_consensus.cc:3054] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.205766 24563 consensus_queue.cc:260] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.206840 24564 raft_consensus.cc:357] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.207594 24564 raft_consensus.cc:383] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.207906 24564 raft_consensus.cc:738] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.208241 24563 ts_tablet_manager.cc:1428] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f: Time spent starting tablet: real 0.007s user 0.003s sys 0.003s
I20250109 21:11:30.209344 24564 consensus_queue.cc:260] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.212152 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:30.213424 24305 leader_election.cc:304] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:30.214164 24495 raft_consensus.cc:3054] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.219206 24564 ts_tablet_manager.cc:1428] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4: Time spent starting tablet: real 0.015s user 0.006s sys 0.000s
I20250109 21:11:30.220885 24495 raft_consensus.cc:2743] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:30.222100 24339 raft_consensus.cc:2463] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:30.222993 24381 leader_election.cc:304] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:30.223647 24549 raft_consensus.cc:2798] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:30.224090 24549 raft_consensus.cc:695] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:30.224781 24265 raft_consensus.cc:2463] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:30.224834 24549 consensus_queue.cc:237] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.225951 24380 leader_election.cc:304] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:30.226729 24584 raft_consensus.cc:2798] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:30.227146 24584 raft_consensus.cc:695] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:30.227859 24584 consensus_queue.cc:237] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.224081 24565 tablet_bootstrap.cc:654] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:30.236671 24565 tablet_bootstrap.cc:492] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5: No bootstrap required, opened a new log
I20250109 21:11:30.237072 24565 ts_tablet_manager.cc:1397] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5: Time spent bootstrapping tablet: real 0.060s user 0.008s sys 0.003s
I20250109 21:11:30.238793 24161 catalog_manager.cc:5526] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 1 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:30.239464 24565 raft_consensus.cc:357] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.240128 24565 raft_consensus.cc:383] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:30.240408 24565 raft_consensus.cc:738] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Initialized, Role: FOLLOWER
I20250109 21:11:30.240408 24161 catalog_manager.cc:5526] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 1 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:30.241096 24565 consensus_queue.cc:260] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.243227 24565 ts_tablet_manager.cc:1428] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5: Time spent starting tablet: real 0.006s user 0.007s sys 0.000s
I20250109 21:11:30.259368 24584 raft_consensus.cc:491] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:30.259887 24584 raft_consensus.cc:513] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.260782 24495 consensus_queue.cc:1035] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.262079 24584 leader_election.cc:290] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:30.262562 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:30.262562 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:30.263324 24339 raft_consensus.cc:2463] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:30.263425 24265 raft_consensus.cc:2463] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 0.
I20250109 21:11:30.264214 24381 leader_election.cc:304] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:30.265203 24549 raft_consensus.cc:2798] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:30.265581 24549 raft_consensus.cc:491] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:30.265905 24549 raft_consensus.cc:3054] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.271504 24549 raft_consensus.cc:513] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.274524 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:30.274996 24575 raft_consensus.cc:491] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:30.275128 24266 raft_consensus.cc:3054] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.275491 24575 raft_consensus.cc:513] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.276247 24549 leader_election.cc:290] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:30.277469 24575 leader_election.cc:290] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.278522 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:30.279167 24339 raft_consensus.cc:3054] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.279667 24575 consensus_queue.cc:1035] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.280201 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:30.279165 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:30.281250 24265 raft_consensus.cc:2388] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 31e6940413e84966ab39625aa5d4ccc5 in current term 1: Already voted for candidate 90c75ac1abda40fd952cb7d88c7d753f in this term.
I20250109 21:11:30.282219 24305 leader_election.cc:304] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:30.285602 24578 raft_consensus.cc:3054] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.287882 24266 raft_consensus.cc:2463] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:30.289501 24380 leader_election.cc:304] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:30.290541 24549 raft_consensus.cc:2798] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:30.291098 24549 raft_consensus.cc:695] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:30.291877 24549 consensus_queue.cc:237] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.299456 24578 raft_consensus.cc:2743] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:30.299863 24552 consensus_queue.cc:1035] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:30.304661 24339 raft_consensus.cc:2463] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 1.
I20250109 21:11:30.320336 24587 consensus_queue.cc:1035] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:30.320335 24161 catalog_manager.cc:5526] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 0 to 1, leader changed from <none> to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 1 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:30.386576 24416 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
mode: GRACEFUL
new_leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:50474
I20250109 21:11:30.387137 24416 raft_consensus.cc:604] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Received request to transfer leadership to TS 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:30.391469 24339 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
mode: GRACEFUL
new_leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:34890
I20250109 21:11:30.391938 24339 raft_consensus.cc:604] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Received request to transfer leadership to TS 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:30.396114 24416 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
mode: GRACEFUL
new_leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:50474
I20250109 21:11:30.396581 24416 raft_consensus.cc:604] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Received request to transfer leadership to TS 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:30.402863 24264 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
mode: GRACEFUL
new_leader_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:35834
I20250109 21:11:30.403365 24264 raft_consensus.cc:604] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Received request to transfer leadership to TS 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:30.407969 24264 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
mode: GRACEFUL
new_leader_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:35834
I20250109 21:11:30.408445 24264 raft_consensus.cc:604] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Received request to transfer leadership to TS 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:30.412674 24416 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
mode: GRACEFUL
new_leader_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:50474
I20250109 21:11:30.413255 24416 raft_consensus.cc:604] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Received request to transfer leadership to TS 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:30.417802 24416 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
mode: GRACEFUL
new_leader_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:50474
I20250109 21:11:30.418213 24416 raft_consensus.cc:604] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Received request to transfer leadership to TS 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:30.422286 24584 consensus_queue.cc:1035] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.428154 24549 raft_consensus.cc:988] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f: : Instructing follower 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:30.428625 24585 raft_consensus.cc:1076] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Signalling peer 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:30.430071 24266 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:35822
I20250109 21:11:30.430693 24266 raft_consensus.cc:491] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:30.431087 24266 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.433508 24585 consensus_queue.cc:1035] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.437733 24266 raft_consensus.cc:513] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.440965 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:30.446053 24266 leader_election.cc:290] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.446342 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:30.447024 24416 raft_consensus.cc:3049] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:30.447434 24416 raft_consensus.cc:738] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:30.448186 24416 consensus_queue.cc:260] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.449506 24416 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.451452 24585 consensus_queue.cc:1035] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.456091 24416 raft_consensus.cc:2463] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:30.457053 24231 leader_election.cc:304] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:30.457742 24587 raft_consensus.cc:2798] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:30.458191 24587 raft_consensus.cc:695] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:30.458811 24585 raft_consensus.cc:988] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: : Instructing follower 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:30.459331 24585 raft_consensus.cc:1076] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Signalling peer 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:30.459091 24587 consensus_queue.cc:237] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.461107 24264 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:35822
I20250109 21:11:30.461648 24264 raft_consensus.cc:491] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:30.462009 24264 raft_consensus.cc:3054] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.462356 24339 raft_consensus.cc:3054] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.469287 24584 consensus_queue.cc:1035] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.469882 24264 raft_consensus.cc:513] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.471122 24266 raft_consensus.cc:1235] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Rejecting Update request from peer 90c75ac1abda40fd952cb7d88c7d753f for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:30.472651 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:30.472806 24159 catalog_manager.cc:5526] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 1 to 2, leader changed from 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195) to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:30.473646 24264 leader_election.cc:290] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.473568 24584 consensus_queue.cc:1046] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:30.474637 24584 raft_consensus.cc:3049] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:30.474987 24584 raft_consensus.cc:738] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:30.475615 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:30.475754 24584 consensus_queue.cc:260] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.476998 24584 raft_consensus.cc:3054] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.489233 24416 raft_consensus.cc:2463] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:30.490845 24231 leader_election.cc:304] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5
I20250109 21:11:30.491598 24587 raft_consensus.cc:2798] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:30.492010 24587 raft_consensus.cc:695] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:30.492739 24587 consensus_queue.cc:237] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.498705 24160 catalog_manager.cc:5526] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 1 to 2, leader changed from 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195) to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:30.538358 24587 consensus_queue.cc:1035] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.548626 24462 consensus_queue.cc:1035] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.652280 24462 raft_consensus.cc:491] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:30.652779 24462 raft_consensus.cc:513] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.654330 24462 leader_election.cc:290] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.655268 24339 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:30.655462 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:30.656041 24339 raft_consensus.cc:2388] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 47125da93b0e4ef8b9e12cd10cd123b4 in current term 1: Already voted for candidate 90c75ac1abda40fd952cb7d88c7d753f in this term.
I20250109 21:11:30.656900 24231 leader_election.cc:304] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:30.657513 24462 raft_consensus.cc:3054] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:30.663117 24462 raft_consensus.cc:2743] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:30.682946 24584 consensus_queue.cc:1035] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.684872 24620 consensus_queue.cc:1035] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:30.704006 24584 consensus_queue.cc:1035] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.714426 24620 consensus_queue.cc:1035] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.729712 24587 raft_consensus.cc:988] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4: : Instructing follower 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:30.730167 24587 raft_consensus.cc:1076] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Signalling peer 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:30.731683 24340 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:34888
I20250109 21:11:30.732167 24340 raft_consensus.cc:491] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:30.732482 24340 raft_consensus.cc:3054] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.739831 24340 raft_consensus.cc:513] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.741580 24340 leader_election.cc:290] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.742902 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:30.743274 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:30.743992 24264 raft_consensus.cc:3049] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:30.743628 24416 raft_consensus.cc:3054] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.744374 24264 raft_consensus.cc:738] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:30.745229 24264 consensus_queue.cc:260] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.746731 24264 raft_consensus.cc:3054] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.752120 24416 raft_consensus.cc:2463] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:30.753082 24306 leader_election.cc:304] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:30.753720 24575 raft_consensus.cc:2798] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:30.754108 24575 raft_consensus.cc:695] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:30.754439 24264 raft_consensus.cc:2463] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:30.754879 24575 consensus_queue.cc:237] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.761674 24159 catalog_manager.cc:5526] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 1 to 2, leader changed from 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193) to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:30.764276 24549 consensus_queue.cc:1035] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.767234 24549 consensus_queue.cc:1035] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.771348 24584 raft_consensus.cc:988] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f: : Instructing follower 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:30.771888 24585 raft_consensus.cc:1076] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Signalling peer 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:30.775605 24340 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:34878
I20250109 21:11:30.776147 24340 raft_consensus.cc:491] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:30.776546 24340 raft_consensus.cc:3054] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.776448 24585 consensus_queue.cc:1035] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.001s
I20250109 21:11:30.783730 24340 raft_consensus.cc:513] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.784832 24339 raft_consensus.cc:1235] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Rejecting Update request from peer 90c75ac1abda40fd952cb7d88c7d753f for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:30.786587 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:30.788615 24340 leader_election.cc:290] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.789182 24549 consensus_queue.cc:1046] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.789906 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:30.790148 24584 raft_consensus.cc:3049] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:30.790591 24584 raft_consensus.cc:738] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:30.791538 24584 consensus_queue.cc:260] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.792532 24584 raft_consensus.cc:3054] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.798848 24585 consensus_queue.cc:1035] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:30.809919 24414 raft_consensus.cc:2463] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:30.811764 24306 leader_election.cc:304] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:30.812295 24624 raft_consensus.cc:988] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f: : Instructing follower 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:30.812582 24575 raft_consensus.cc:2798] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:30.812783 24549 raft_consensus.cc:1076] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Signalling peer 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:30.813160 24575 raft_consensus.cc:695] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:30.814018 24575 consensus_queue.cc:237] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.814388 24339 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:34878
I20250109 21:11:30.815157 24339 raft_consensus.cc:491] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:30.815569 24339 raft_consensus.cc:3054] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.821377 24339 raft_consensus.cc:513] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.822836 24339 leader_election.cc:290] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.823789 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:30.823865 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:30.824522 24414 raft_consensus.cc:3049] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:30.824826 24266 raft_consensus.cc:3054] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.824939 24414 raft_consensus.cc:738] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:30.825757 24414 consensus_queue.cc:260] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.826802 24414 raft_consensus.cc:3054] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.829191 24160 catalog_manager.cc:5526] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 1 to 2, leader changed from 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195) to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:30.830482 24266 raft_consensus.cc:2463] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:30.832192 24305 leader_election.cc:304] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:30.832957 24575 raft_consensus.cc:2798] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:30.833149 24414 raft_consensus.cc:2463] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:30.853174 24575 raft_consensus.cc:695] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:30.854105 24575 consensus_queue.cc:237] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.859411 24578 raft_consensus.cc:988] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5: : Instructing follower 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:30.860052 24575 raft_consensus.cc:1076] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Signalling peer 47125da93b0e4ef8b9e12cd10cd123b4 to start an election
I20250109 21:11:30.862604 24160 catalog_manager.cc:5526] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 1 to 2, leader changed from 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195) to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:30.863394 24266 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
from {username='slave'} at 127.0.0.1:35808
I20250109 21:11:30.863997 24266 raft_consensus.cc:491] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:30.864358 24266 raft_consensus.cc:3054] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.865383 24462 raft_consensus.cc:988] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4: : Instructing follower 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:30.865867 24587 raft_consensus.cc:1076] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Signalling peer 31e6940413e84966ab39625aa5d4ccc5 to start an election
I20250109 21:11:30.867161 24339 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
from {username='slave'} at 127.0.0.1:34888
I20250109 21:11:30.867643 24339 raft_consensus.cc:491] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:30.867993 24339 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.870626 24266 raft_consensus.cc:513] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.872465 24266 leader_election.cc:290] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Requested vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.873421 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:30.874070 24414 raft_consensus.cc:3054] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.874545 24339 raft_consensus.cc:513] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.876271 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:30.876868 24340 raft_consensus.cc:3049] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:30.877144 24340 raft_consensus.cc:738] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:30.877840 24340 consensus_queue.cc:260] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.879024 24340 raft_consensus.cc:3054] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.879942 24339 leader_election.cc:290] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:30.880055 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:30.881471 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:30.882066 24416 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.881640 24266 raft_consensus.cc:3049] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:30.883067 24266 raft_consensus.cc:738] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:30.883720 24266 consensus_queue.cc:260] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.884618 24266 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.885123 24340 raft_consensus.cc:2463] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:30.886297 24231 leader_election.cc:304] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4; no voters:
I20250109 21:11:30.887084 24587 raft_consensus.cc:2798] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:30.887565 24587 raft_consensus.cc:695] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Leader. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:30.888324 24587 consensus_queue.cc:237] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.888751 24416 raft_consensus.cc:2463] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:30.880906 24414 raft_consensus.cc:2463] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 47125da93b0e4ef8b9e12cd10cd123b4 in term 2.
I20250109 21:11:30.889919 24306 leader_election.cc:304] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:30.890414 24266 raft_consensus.cc:2463] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:30.890739 24636 raft_consensus.cc:2798] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:30.893499 24636 raft_consensus.cc:695] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Becoming Leader. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:30.894299 24636 consensus_queue.cc:237] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:30.896082 24160 catalog_manager.cc:5526] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 reported cstate change: term changed from 1 to 2, leader changed from 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194) to 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:30.901578 24159 catalog_manager.cc:5526] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 reported cstate change: term changed from 1 to 2, leader changed from 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193) to 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "31e6940413e84966ab39625aa5d4ccc5" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:30.948822 24414 raft_consensus.cc:1270] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:30.949930 24587 consensus_queue.cc:1035] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:30.956810 24340 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:30.963470 24340 raft_consensus.cc:1270] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:30.964640 24620 consensus_queue.cc:1035] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.004020 24414 raft_consensus.cc:1270] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.005131 24620 consensus_queue.cc:1035] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.012178 24340 raft_consensus.cc:3054] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:31.020653 24340 raft_consensus.cc:1270] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.022625 24620 consensus_queue.cc:1035] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.235865 24266 raft_consensus.cc:1270] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.237239 24636 consensus_queue.cc:1035] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.246191 24414 raft_consensus.cc:1270] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.247471 24578 consensus_queue.cc:1035] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.309485 24414 raft_consensus.cc:1270] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.309990 24340 raft_consensus.cc:1270] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.310716 24578 consensus_queue.cc:1035] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.311131 24552 consensus_queue.cc:1035] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.318293 24266 raft_consensus.cc:1270] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.320077 24636 consensus_queue.cc:1035] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.320775 24416 raft_consensus.cc:1270] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 47125da93b0e4ef8b9e12cd10cd123b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.322288 24462 consensus_queue.cc:1035] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.336040 24414 raft_consensus.cc:1270] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.337445 24636 consensus_queue.cc:1035] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.344640 24266 raft_consensus.cc:3054] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:31.351341 24266 raft_consensus.cc:1270] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.352442 24575 consensus_queue.cc:1035] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.384661 24266 raft_consensus.cc:1270] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.385764 24575 consensus_queue.cc:1035] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:31.393359 24414 raft_consensus.cc:1270] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Refusing update from remote peer 31e6940413e84966ab39625aa5d4ccc5: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:31.395213 24634 consensus_queue.cc:1035] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [LEADER]: Connected to new peer: Peer: permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:33.423144 24159 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:48582:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20250109 21:11:33.440804 24159 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:48582:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20250109 21:11:33.514371 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
W20250109 21:11:33.592226 24661 log.cc:926] Time spent T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f: Append to log took a long time: real 0.072s user 0.001s sys 0.000s
W20250109 21:11:33.642618 24660 log.cc:926] Time spent T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5: Append to log took a long time: real 0.058s user 0.001s sys 0.000s
I20250109 21:11:33.726593 24693 tablet.cc:1721] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250109 21:11:33.731139 24442 tablet_mm_ops.cc:139] Rowset compaction is disabled (check --enable_rowset_compaction and disable_compaction in extra_config for tablet:2695abb92d0b4ffab484d8559954101a)
W20250109 21:11:33.741597 24442 tablet_mm_ops.cc:304] Major delta compaction is disabled (check --enable_major_delta_compaction and disable_compaction in extra_config for tablet:2695abb92d0b4ffab484d8559954101a)
W20250109 21:11:33.763309 24442 tablet_mm_ops.cc:220] Minor delta compaction is disabled (check --enable_minor_delta_compaction and disable_compaction in extra_config for tablet:2695abb92d0b4ffab484d8559954101a)
I20250109 21:11:33.805230 24689 tablet.cc:1721] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:33.836710 24266 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
mode: GRACEFUL
new_leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
from {username='slave'} at 127.0.0.1:34876
I20250109 21:11:33.854064 24266 raft_consensus.cc:604] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Received request to transfer leadership to TS 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:33.859279 24698 tablet.cc:1721] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:33.863402 24692 tablet.cc:1721] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250109 21:11:33.871192 24682 log.cc:926] Time spent T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5: Append to log took a long time: real 0.094s user 0.001s sys 0.000s
I20250109 21:11:33.878767 24699 tablet.cc:1721] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:33.879545 24701 tablet.cc:1721] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250109 21:11:33.894389 24691 log.cc:926] Time spent T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: Append to log took a long time: real 0.056s user 0.000s sys 0.000s
W20250109 21:11:33.909204 24690 log.cc:926] Time spent T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5: Append to log took a long time: real 0.074s user 0.001s sys 0.000s
I20250109 21:11:33.940727 24693 tablet.cc:1721] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250109 21:11:34.008862 24231 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.194:45507, user_credentials={real_user=slave}} blocked reactor thread for 89456.9us
I20250109 21:11:34.024571 24713 tablet.cc:1721] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.025146 24703 tablet.cc:1721] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.026774 24684 raft_consensus.cc:988] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: : Instructing follower 90c75ac1abda40fd952cb7d88c7d753f to start an election
I20250109 21:11:34.027244 24684 raft_consensus.cc:1076] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Signalling peer 90c75ac1abda40fd952cb7d88c7d753f to start an election
I20250109 21:11:34.036319 24414 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
from {username='slave'} at 127.0.0.1:50458
I20250109 21:11:34.036933 24414 raft_consensus.cc:491] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:34.037331 24414 raft_consensus.cc:3054] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:34.008011 24689 tablet.cc:1721] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.051270 24714 tablet.cc:1721] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.075006 24414 raft_consensus.cc:513] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.009037 24692 tablet.cc:1721] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.080050 24414 leader_election.cc:290] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:34.080580 24338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:34.081214 24338 raft_consensus.cc:3054] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:34.081876 24701 tablet.cc:1721] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.083503 24265 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:34.084089 24265 raft_consensus.cc:3049] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:34.084371 24265 raft_consensus.cc:738] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:34.088204 24415 raft_consensus.cc:1235] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Rejecting Update request from peer 47125da93b0e4ef8b9e12cd10cd123b4 for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:34.088337 24265 consensus_queue.cc:260] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 1.2, Last appended by leader: 2, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.055795 24698 tablet.cc:1721] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.089218 24265 raft_consensus.cc:3054] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:34.091220 24707 tablet.cc:1721] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.106271 24715 tablet.cc:1721] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250109 21:11:34.090556 24712 consensus_queue.cc:1159] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue is closed or peer was untracked, disregarding peer response. Response: responder_uuid: "31e6940413e84966ab39625aa5d4ccc5" responder_term: 1 status { last_received { term: 1 index: 2 } last_committed_idx: 1 last_received_current_leader { term: 1 index: 2 } }
I20250109 21:11:34.086244 24689 tablet.cc:1721] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.100258 24340 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
mode: GRACEFUL
new_leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
from {username='slave'} at 127.0.0.1:46248
I20250109 21:11:34.126941 24340 raft_consensus.cc:604] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Received request to transfer leadership to TS 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:34.117426 24703 tablet.cc:1721] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.128468 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 2
I20250109 21:11:34.129102 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:34.108179 24338 raft_consensus.cc:2463] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 2.
I20250109 21:11:34.131172 24381 leader_election.cc:304] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:34.137290 24693 tablet.cc:1721] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.138589 24338 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "47768a3814874f04ac7599523949bd81"
dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
mode: GRACEFUL
new_leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
from {username='slave'} at 127.0.0.1:46248
I20250109 21:11:34.139274 24338 raft_consensus.cc:604] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Received request to transfer leadership to TS 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:34.088248 24705 tablet.cc:1721] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.106319 24699 tablet.cc:1721] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.142071 24266 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2"
dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
mode: GRACEFUL
new_leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
from {username='slave'} at 127.0.0.1:34876
I20250109 21:11:34.148541 24713 tablet.cc:1721] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.142089 24549 raft_consensus.cc:2798] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:34.150301 24698 tablet.cc:1721] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.149268 24266 raft_consensus.cc:604] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Received request to transfer leadership to TS 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:34.142362 24265 raft_consensus.cc:2463] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 2.
I20250109 21:11:34.152500 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250109 21:11:34.150929 24549 raft_consensus.cc:695] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:34.153338 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:34.153709 24549 consensus_queue.cc:237] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.2, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.145536 24714 tablet.cc:1721] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.156287 24703 tablet.cc:1721] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.182595 24667 raft_consensus.cc:988] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5: : Instructing follower 90c75ac1abda40fd952cb7d88c7d753f to start an election
I20250109 21:11:34.184288 24575 raft_consensus.cc:1076] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Signalling peer 90c75ac1abda40fd952cb7d88c7d753f to start an election
I20250109 21:11:34.193784 24160 catalog_manager.cc:5526] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 1 to 2, leader changed from 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193) to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 2 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:34.195150 24414 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "47768a3814874f04ac7599523949bd81"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
from {username='slave'} at 127.0.0.1:50456
I20250109 21:11:34.195823 24414 raft_consensus.cc:491] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:34.196188 24414 raft_consensus.cc:3054] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:34.195195 24160 catalog_manager.cc:5618] TS 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483) does not have the latest schema for tablet 2019fe427a7d4c7fb03282c91b0d7176 (table soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]). Expected version 1 got 0
I20250109 21:11:34.206733 24414 raft_consensus.cc:513] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.208926 24414 leader_election.cc:290] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 2 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:34.210088 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:34.210309 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:34.210788 24266 raft_consensus.cc:3054] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:34.210829 24340 raft_consensus.cc:3049] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:34.211761 24340 raft_consensus.cc:738] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:34.212460 24340 consensus_queue.cc:260] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.213655 24340 raft_consensus.cc:3054] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:34.218178 24266 raft_consensus.cc:2463] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 2.
I20250109 21:11:34.219343 24380 leader_election.cc:304] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:34.220069 24549 raft_consensus.cc:2798] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:34.220547 24549 raft_consensus.cc:695] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:34.221325 24549 consensus_queue.cc:237] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.221705 24161 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac: soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af] alter complete (version 1)
I20250109 21:11:34.223951 24340 raft_consensus.cc:2463] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 2.
I20250109 21:11:34.237990 24161 catalog_manager.cc:5526] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 1 to 2, leader changed from 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194) to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 2 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:34.360916 24575 raft_consensus.cc:988] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5: : Instructing follower 90c75ac1abda40fd952cb7d88c7d753f to start an election
I20250109 21:11:34.361449 24677 raft_consensus.cc:1076] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Signalling peer 90c75ac1abda40fd952cb7d88c7d753f to start an election
I20250109 21:11:34.362887 24414 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
from {username='slave'} at 127.0.0.1:50456
I20250109 21:11:34.363384 24414 raft_consensus.cc:491] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:34.363657 24414 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:34.368181 24414 raft_consensus.cc:513] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.369663 24414 leader_election.cc:290] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:34.370414 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:34.370647 24340 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:34.371111 24266 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:34.371291 24340 raft_consensus.cc:3049] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:34.371701 24340 raft_consensus.cc:738] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 31e6940413e84966ab39625aa5d4ccc5, State: Running, Role: LEADER
I20250109 21:11:34.372402 24340 consensus_queue.cc:260] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.373585 24340 raft_consensus.cc:3054] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:34.377755 24266 raft_consensus.cc:2463] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 3.
I20250109 21:11:34.378753 24380 leader_election.cc:304] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:34.379482 24549 raft_consensus.cc:2798] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:34.379724 24340 raft_consensus.cc:2463] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 3.
I20250109 21:11:34.379979 24549 raft_consensus.cc:695] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:34.380896 24549 consensus_queue.cc:237] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.391086 24161 catalog_manager.cc:5526] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 2 to 3, leader changed from 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194) to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 3 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:34.551857 24266 raft_consensus.cc:1270] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:11:34.552901 24549 consensus_queue.cc:1035] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:34.558296 24714 tablet.cc:1721] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.560286 24340 raft_consensus.cc:1270] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 1 index: 2. Preceding OpId from leader: term: 2 index: 3. (index mismatch)
I20250109 21:11:34.561733 24549 consensus_queue.cc:1035] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:34.564901 24701 tablet.cc:1721] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:34.580945 24161 catalog_manager.cc:5618] TS 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507) does not have the latest schema for tablet 2019fe427a7d4c7fb03282c91b0d7176 (table soft_deleted_table [id=4f4aa082a4b44ef5b989c45a7f6d78af]). Expected version 1 got 0
I20250109 21:11:34.588560 24714 tablet.cc:1716] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f: Skipping requested alter to schema version 1, tablet already version 1
I20250109 21:11:34.590668 24701 tablet.cc:1716] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5: Skipping requested alter to schema version 1, tablet already version 1
I20250109 21:11:34.593075 24713 tablet.cc:1716] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: Skipping requested alter to schema version 1, tablet already version 1
I20250109 21:11:34.624390 24338 raft_consensus.cc:1270] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:34.625502 24722 consensus_queue.cc:1035] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:34.633481 24266 raft_consensus.cc:1270] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:34.635666 24723 consensus_queue.cc:1035] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:34.645370 24462 raft_consensus.cc:988] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4: : Instructing follower 90c75ac1abda40fd952cb7d88c7d753f to start an election
I20250109 21:11:34.645831 24712 raft_consensus.cc:1076] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Signalling peer 90c75ac1abda40fd952cb7d88c7d753f to start an election
I20250109 21:11:34.647871 24414 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2"
dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
from {username='slave'} at 127.0.0.1:50458
I20250109 21:11:34.648427 24414 raft_consensus.cc:491] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:34.648823 24414 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:34.656703 24414 raft_consensus.cc:513] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.698187 24414 leader_election.cc:290] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:34.703341 24338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:34.705262 24338 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:34.714560 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:34.715606 24266 raft_consensus.cc:3049] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:34.715904 24266 raft_consensus.cc:738] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:34.716863 24266 consensus_queue.cc:260] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.718747 24338 raft_consensus.cc:2463] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 3.
I20250109 21:11:34.718950 24266 raft_consensus.cc:3054] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:34.720415 24381 leader_election.cc:304] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:34.721851 24723 raft_consensus.cc:2798] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:34.722348 24723 raft_consensus.cc:695] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:34.724543 24723 consensus_queue.cc:237] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:34.727866 24266 raft_consensus.cc:2463] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 3.
I20250109 21:11:34.734383 24160 catalog_manager.cc:5526] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 2 to 3, leader changed from 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193) to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 3 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:34.940076 24338 raft_consensus.cc:1270] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:11:34.941347 24723 consensus_queue.cc:1035] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:11:34.953866 24266 raft_consensus.cc:1270] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:11:34.955785 24695 consensus_queue.cc:1035] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:11:35.154438 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:35.159952 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:35.160290 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:35.165050 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:35.165495 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:35.235183 24265 raft_consensus.cc:1270] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:35.236312 24695 consensus_queue.cc:1035] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:35.245074 24338 raft_consensus.cc:1270] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:35.246584 24695 consensus_queue.cc:1035] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:36.166385 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:36.171128 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:36.171514 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:36.175846 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:36.176199 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:37.176887 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:37.181538 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:37.181960 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:37.186761 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:37.187090 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:38.187796 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:38.192513 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:38.192904 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:38.197273 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:38.197615 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:39.198302 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:39.202811 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:39.203169 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:39.207495 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:39.207787 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:40.208467 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:40.213153 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:40.213495 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:40.217697 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:40.217975 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:41.218698 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:41.223763 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:41.224093 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:41.228387 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:41.228765 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:42.229502 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:42.235617 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:42.236186 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:42.241942 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:42.242280 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:43.607717 24744 raft_consensus.cc:491] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31e6940413e84966ab39625aa5d4ccc5)
I20250109 21:11:43.608513 24744 raft_consensus.cc:513] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:43.612111 24744 leader_election.cc:290] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:43.820128 24744 raft_consensus.cc:491] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31e6940413e84966ab39625aa5d4ccc5)
I20250109 21:11:43.820667 24744 raft_consensus.cc:513] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:43.822813 24744 leader_election.cc:290] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:43.828042 24748 raft_consensus.cc:491] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:43.828593 24748 raft_consensus.cc:513] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:43.831836 24748 leader_election.cc:290] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:43.976965 24744 raft_consensus.cc:491] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31e6940413e84966ab39625aa5d4ccc5)
I20250109 21:11:43.977820 24744 raft_consensus.cc:513] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:43.980235 24744 leader_election.cc:290] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.032899 24746 raft_consensus.cc:491] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.033867 24746 raft_consensus.cc:513] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.036818 24746 leader_election.cc:290] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.038990 24747 raft_consensus.cc:491] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.049091 24747 raft_consensus.cc:513] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.049371 24748 raft_consensus.cc:491] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.050007 24748 raft_consensus.cc:513] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:44.051110 24747 leader_election.cc:290] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.054358 24748 leader_election.cc:290] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483), 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407)
I20250109 21:11:44.056206 24744 raft_consensus.cc:491] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31e6940413e84966ab39625aa5d4ccc5)
I20250109 21:11:44.056813 24744 raft_consensus.cc:513] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.057744 24748 raft_consensus.cc:491] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.058364 24748 raft_consensus.cc:513] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.059814 24743 raft_consensus.cc:491] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.060489 24745 raft_consensus.cc:491] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.060314 24743 raft_consensus.cc:513] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.061035 24748 leader_election.cc:290] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.060999 24745 raft_consensus.cc:513] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.062394 24743 leader_election.cc:290] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.058835 24744 leader_election.cc:290] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.063087 24745 leader_election.cc:290] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.066741 24411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.067349 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.067646 24411 raft_consensus.cc:2463] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:44.068871 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.069096 24746 raft_consensus.cc:491] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.069929 24415 raft_consensus.cc:2463] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:44.069944 24746 raft_consensus.cc:513] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.071240 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f608b6f2484784be332e75fc641b47" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.071833 24415 raft_consensus.cc:2463] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 1.
I20250109 21:11:44.072590 24746 leader_election.cc:290] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.073246 24746 raft_consensus.cc:491] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.075417 24747 raft_consensus.cc:491] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.076041 24747 raft_consensus.cc:513] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.077136 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.077924 24747 leader_election.cc:290] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.078477 24747 raft_consensus.cc:491] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.079545 24745 raft_consensus.cc:491] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.080027 24745 raft_consensus.cc:513] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.077867 24415 raft_consensus.cc:2463] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:44.082082 24745 leader_election.cc:290] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.084093 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.084784 24747 raft_consensus.cc:513] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.089638 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.073817 24746 raft_consensus.cc:513] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.090359 24415 raft_consensus.cc:2463] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 31e6940413e84966ab39625aa5d4ccc5 in term 2.
I20250109 21:11:44.092227 24747 leader_election.cc:290] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.093493 24746 leader_election.cc:290] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.094118 24746 raft_consensus.cc:491] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.094607 24746 raft_consensus.cc:513] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.096343 24746 leader_election.cc:290] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 4 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.102028 24745 raft_consensus.cc:491] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31e6940413e84966ab39625aa5d4ccc5)
I20250109 21:11:44.102589 24745 raft_consensus.cc:513] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.107743 24745 leader_election.cc:290] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.111493 24748 raft_consensus.cc:491] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.120826 24748 raft_consensus.cc:513] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.129068 24753 raft_consensus.cc:491] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.129842 24748 leader_election.cc:290] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.129673 24753 raft_consensus.cc:513] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.131356 24306 leader_election.cc:304] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:44.131657 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.132367 24306 leader_election.cc:304] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:44.133533 24748 raft_consensus.cc:2798] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:44.133949 24748 raft_consensus.cc:491] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.134357 24748 raft_consensus.cc:3054] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.134685 24753 leader_election.cc:290] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:44.135048 24754 raft_consensus.cc:2798] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:44.136641 24754 raft_consensus.cc:491] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.137066 24754 raft_consensus.cc:3054] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.136890 24411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.138952 24411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.141096 24411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.142840 24306 leader_election.cc:304] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:44.143831 24755 raft_consensus.cc:2798] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader pre-election won for term 2
I20250109 21:11:44.144002 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.144253 24755 raft_consensus.cc:491] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Starting leader election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.144501 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.144696 24755 raft_consensus.cc:3054] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:44.145207 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.147048 24745 raft_consensus.cc:491] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 90c75ac1abda40fd952cb7d88c7d753f)
I20250109 21:11:44.147563 24745 raft_consensus.cc:513] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.148599 24266 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.149482 24745 leader_election.cc:290] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.150804 24411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.151505 24306 leader_election.cc:304] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:44.152302 24747 raft_consensus.cc:2798] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:44.152652 24306 leader_election.cc:304] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters:
I20250109 21:11:44.152679 24747 raft_consensus.cc:491] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.154022 24747 raft_consensus.cc:3054] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.154382 24263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.162439 24336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.162988 24745 raft_consensus.cc:491] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31e6940413e84966ab39625aa5d4ccc5)
I20250109 21:11:44.163322 24336 raft_consensus.cc:2463] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 2.
I20250109 21:11:44.163611 24745 raft_consensus.cc:513] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.165549 24748 raft_consensus.cc:513] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.167536 24748 leader_election.cc:290] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.168046 24747 raft_consensus.cc:513] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.169360 24381 leader_election.cc:304] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:44.169991 24747 leader_election.cc:290] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.162284 24754 raft_consensus.cc:513] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.167536 24745 leader_election.cc:290] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.172286 24746 raft_consensus.cc:2798] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:44.175091 24746 raft_consensus.cc:491] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.175648 24746 raft_consensus.cc:3054] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.173748 24751 raft_consensus.cc:2798] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election won for term 3
I20250109 21:11:44.176172 24751 raft_consensus.cc:491] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting leader election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:44.176643 24751 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.177709 24262 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.177917 24263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.179715 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f608b6f2484784be332e75fc641b47" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.181533 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.182839 24749 raft_consensus.cc:491] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 31e6940413e84966ab39625aa5d4ccc5)
I20250109 21:11:44.183182 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "47768a3814874f04ac7599523949bd81" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.183398 24749 raft_consensus.cc:513] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.185454 24749 leader_election.cc:290] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:44.186103 24263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.173180 24754 leader_election.cc:290] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.185003 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.189586 24336 raft_consensus.cc:1235] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Rejecting Update request from peer 47125da93b0e4ef8b9e12cd10cd123b4 for earlier term 2. Current term is 3. Ops: []
I20250109 21:11:44.189976 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.191232 24336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "859d68415c0b4960b495b4ab9d067e3c" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.191725 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.193193 24336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1e6f26fa5c544ef7933cf72e192c178b" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.194746 24263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.195086 24336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d6d844a03cb4427999b61cac0644403d" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.196830 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" is_pre_election: true
I20250109 21:11:44.197178 24336 raft_consensus.cc:1235] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Rejecting Update request from peer 47125da93b0e4ef8b9e12cd10cd123b4 for earlier term 2. Current term is 3. Ops: []
I20250109 21:11:44.197363 24755 raft_consensus.cc:513] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:44.198344 24338 raft_consensus.cc:1235] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Rejecting Update request from peer 47125da93b0e4ef8b9e12cd10cd123b4 for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:44.198410 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:44.198714 24263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:44.200409 24263 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:44.201169 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f608b6f2484784be332e75fc641b47" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:44.201335 24338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.202518 24411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.201504 24751 raft_consensus.cc:513] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.202073 24755 leader_election.cc:290] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Requested vote from peers 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483), 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407)
I20250109 21:11:44.204267 24411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50630bfe825448bab1eaa3beb904b50b" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.205240 24746 raft_consensus.cc:513] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.205624 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "691aaa81f1d6437da0eb8c8ec267a1a2" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.206036 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:44.206995 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.207719 24414 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c234860bfa0449b58932d751ed0c8e7d" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:44.208284 24412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "98a0770c333f4e0881b843f212d91888" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:44.208456 24338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "38a1ab3bdf884c52923588d4425c6632" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.208777 24415 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.209501 24305 leader_election.cc:304] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.209573 24416 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5d6de8b7d8c94a9e961d7e1378867508" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:44.210618 24748 raft_consensus.cc:2743] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.210856 24336 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8adff09d64b444eabbb6a7bd0f97de6a" candidate_uuid: "90c75ac1abda40fd952cb7d88c7d753f" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5"
I20250109 21:11:44.210868 24412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f" is_pre_election: true
I20250109 21:11:44.211634 24336 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.205291 24751 leader_election.cc:290] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:44.213304 24746 leader_election.cc:290] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 election: Requested vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195:34483)
I20250109 21:11:44.213514 24305 leader_election.cc:304] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.214258 24746 raft_consensus.cc:2743] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.215272 24338 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2019fe427a7d4c7fb03282c91b0d7176" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 4 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.216264 24381 leader_election.cc:304] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:44.216661 24337 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "d58d0e7f91b54d7cbbdbb2dd51ae5c28" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 2 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.217911 24751 raft_consensus.cc:2743] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.218375 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "7944e0ea090a460db2c4f7b3d6be4a35" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 4 candidate_status { last_received { term: 3 index: 4 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.219776 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "1ef9bafd58c04d77b597d7dc1570df26" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.220274 24337 raft_consensus.cc:1235] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Rejecting Update request from peer 47125da93b0e4ef8b9e12cd10cd123b4 for earlier term 2. Current term is 3. Ops: []
I20250109 21:11:44.220995 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "50630bfe825448bab1eaa3beb904b50b" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.221858 24338 raft_consensus.cc:1235] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Rejecting Update request from peer 47125da93b0e4ef8b9e12cd10cd123b4 for earlier term 2. Current term is 3. Ops: []
I20250109 21:11:44.222388 24341 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "2695abb92d0b4ffab484d8559954101a" candidate_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "31e6940413e84966ab39625aa5d4ccc5" is_pre_election: true
I20250109 21:11:44.223373 24264 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "47125da93b0e4ef8b9e12cd10cd123b4"
I20250109 21:11:44.224607 24411 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "39f608b6f2484784be332e75fc641b47" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:44.224924 24412 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f578e2ab431947e0805d2c6967d43dc3" candidate_uuid: "31e6940413e84966ab39625aa5d4ccc5" candidate_term: 3 candidate_status { last_received { term: 2 index: 3 } } ignore_live_leader: false dest_uuid: "90c75ac1abda40fd952cb7d88c7d753f"
I20250109 21:11:44.225354 24336 raft_consensus.cc:2463] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 90c75ac1abda40fd952cb7d88c7d753f in term 3.
I20250109 21:11:44.225314 24758 consensus_queue.cc:1046] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.001s
I20250109 21:11:44.226392 24340 raft_consensus.cc:1235] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Rejecting Update request from peer 47125da93b0e4ef8b9e12cd10cd123b4 for earlier term 2. Current term is 3. Ops: []
I20250109 21:11:44.226655 24750 raft_consensus.cc:3049] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:44.226866 24231 leader_election.cc:304] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.227159 24750 raft_consensus.cc:738] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:44.227712 24758 raft_consensus.cc:2743] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.227137 24306 leader_election.cc:304] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.228245 24750 consensus_queue.cc:260] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.228853 24231 leader_election.cc:304] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.228979 24381 leader_election.cc:304] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f; no voters: 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:44.229575 24306 leader_election.cc:304] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.229624 24758 raft_consensus.cc:2743] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.229866 24750 raft_consensus.cc:3054] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.230592 24231 leader_election.cc:304] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.230993 24748 raft_consensus.cc:2743] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250109 21:11:44.231386 24758 raft_consensus.cc:2743] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.232132 24306 leader_election.cc:304] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.232159 24758 consensus_queue.cc:1046] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:11:44.232475 24745 consensus_queue.cc:1046] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:44.232995 24748 raft_consensus.cc:2743] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250109 21:11:44.233238 24743 raft_consensus.cc:3049] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:44.233421 24758 raft_consensus.cc:3049] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:44.233656 24743 raft_consensus.cc:738] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:44.233816 24758 raft_consensus.cc:738] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:44.234030 24306 leader_election.cc:304] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.234797 24748 raft_consensus.cc:2743] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.234629 24758 consensus_queue.cc:260] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:44.234591 24743 consensus_queue.cc:260] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.235967 24306 leader_election.cc:304] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.236207 24758 raft_consensus.cc:3054] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:44.236259 24743 raft_consensus.cc:3054] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.236697 24748 raft_consensus.cc:2743] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.237804 24306 leader_election.cc:304] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.230265 24746 raft_consensus.cc:2743] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.238499 24748 raft_consensus.cc:2743] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:44.230206 24751 raft_consensus.cc:2798] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:44.239349 24751 raft_consensus.cc:695] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 3 LEADER]: Becoming Leader. State: Replica: 90c75ac1abda40fd952cb7d88c7d753f, State: Running, Role: LEADER
I20250109 21:11:44.240267 24751 consensus_queue.cc:237] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.240653 24306 leader_election.cc:304] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.242188 24755 raft_consensus.cc:2743] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.232587 24231 leader_election.cc:304] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.244165 24306 leader_election.cc:304] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 2 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.245031 24755 raft_consensus.cc:2743] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Leader election lost for term 2. Reason: could not achieve majority
I20250109 21:11:44.245138 24231 leader_election.cc:304] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.246060 24758 raft_consensus.cc:2743] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.246469 24231 leader_election.cc:304] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.246716 24758 raft_consensus.cc:2743] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.247123 24750 raft_consensus.cc:2743] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:44.248003 24231 leader_election.cc:304] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 4 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.248538 24750 raft_consensus.cc:2743] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Leader pre-election lost for term 4. Reason: could not achieve majority
I20250109 21:11:44.248914 24231 leader_election.cc:304] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.249074 24306 leader_election.cc:304] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [CANDIDATE]: Term 3 election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 31e6940413e84966ab39625aa5d4ccc5; no voters: 47125da93b0e4ef8b9e12cd10cd123b4, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.249786 24750 raft_consensus.cc:2743] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.249882 24755 raft_consensus.cc:2743] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Leader election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.250384 24758 consensus_queue.cc:1046] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:11:44.251334 24750 raft_consensus.cc:3049] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:44.251746 24750 raft_consensus.cc:738] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:44.251765 24231 leader_election.cc:304] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.252980 24758 raft_consensus.cc:2743] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:44.252741 24750 consensus_queue.cc:260] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.253499 20003 auto_leader_rebalancer.cc:140] leader rebalance for table soft_deleted_table
I20250109 21:11:44.253592 24744 consensus_queue.cc:1046] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: INVALID_TERM, Last received: 2.2, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:44.254099 24750 raft_consensus.cc:3054] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.254616 24744 raft_consensus.cc:3049] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:44.255050 24744 raft_consensus.cc:738] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:44.255143 24161 catalog_manager.cc:5526] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f reported cstate change: term changed from 2 to 3, leader changed from 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193) to 90c75ac1abda40fd952cb7d88c7d753f (127.19.136.195). New cstate: current_term: 3 leader_uuid: "90c75ac1abda40fd952cb7d88c7d753f" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:44.255858 24744 consensus_queue.cc:260] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.256935 24744 raft_consensus.cc:3054] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.254530 24231 leader_election.cc:304] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 47125da93b0e4ef8b9e12cd10cd123b4; no voters: 31e6940413e84966ab39625aa5d4ccc5, 90c75ac1abda40fd952cb7d88c7d753f
I20250109 21:11:44.260471 24758 raft_consensus.cc:2743] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:44.260963 24750 consensus_queue.cc:1046] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: INVALID_TERM, Last received: 2.3, Next index: 4, Last known committed idx: 3, Time since last communication: 0.000s
I20250109 21:11:44.261720 20003 auto_leader_rebalancer.cc:388] table: soft_deleted_table, leader rebalance finish, leader transfer count: 0
I20250109 21:11:44.261976 24750 raft_consensus.cc:3049] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:44.262248 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:44.262328 24750 raft_consensus.cc:738] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: 47125da93b0e4ef8b9e12cd10cd123b4, State: Running, Role: LEADER
I20250109 21:11:44.263010 24411 raft_consensus.cc:1235] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 3 LEADER]: Rejecting Update request from peer 47125da93b0e4ef8b9e12cd10cd123b4 for earlier term 2. Current term is 3. Ops: []
I20250109 21:11:44.263293 24750 consensus_queue.cc:260] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 3, Committed index: 3, Last appended: 2.3, Last appended by leader: 3, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:44.265947 24750 raft_consensus.cc:3054] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:44.269896 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:44.270326 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
W20250109 21:11:44.824548 24437 debug-util.cc:398] Leaking SignalData structure 0x7b0800193e00 after lost signal to thread 20006
W20250109 21:11:44.827384 24437 debug-util.cc:398] Leaking SignalData structure 0x7b0800317600 after lost signal to thread 24198
W20250109 21:11:44.829733 24437 debug-util.cc:398] Leaking SignalData structure 0x7b08000ec720 after lost signal to thread 24290
W20250109 21:11:44.831028 24437 debug-util.cc:398] Leaking SignalData structure 0x7b08002abc20 after lost signal to thread 24366
W20250109 21:11:44.832324 24437 debug-util.cc:398] Leaking SignalData structure 0x7b08001b51c0 after lost signal to thread 24440
I20250109 21:11:44.853912 24264 raft_consensus.cc:1270] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:11:44.855434 24759 consensus_queue.cc:1035] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
I20250109 21:11:44.876758 24336 raft_consensus.cc:1270] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Refusing update from remote peer 90c75ac1abda40fd952cb7d88c7d753f: Log matching property violated. Preceding OpId in replica: term: 2 index: 3. Preceding OpId from leader: term: 3 index: 4. (index mismatch)
I20250109 21:11:44.879007 24751 consensus_queue.cc:1035] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [LEADER]: Connected to new peer: Peer: permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 4, Last known committed idx: 3, Time since last communication: 0.001s
/home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/auto_leader_rebalancer-test.cc:600: Failure
Expected equality of these values:
leader.second
Which is: 2
3
I20250109 21:11:45.331540 20003 tablet_server.cc:178] TabletServer@127.19.136.193:0 shutting down...
I20250109 21:11:45.371948 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:11:45.372807 20003 tablet_replica.cc:331] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.374037 20003 raft_consensus.cc:2238] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.375064 20003 raft_consensus.cc:2267] T 1e6f26fa5c544ef7933cf72e192c178b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.378146 20003 tablet_replica.cc:331] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.378779 20003 raft_consensus.cc:2238] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.379671 20003 raft_consensus.cc:2267] T 2019fe427a7d4c7fb03282c91b0d7176 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.382589 20003 tablet_replica.cc:331] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.383386 20003 raft_consensus.cc:2238] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.384240 20003 raft_consensus.cc:2267] T 38a1ab3bdf884c52923588d4425c6632 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:45.385121 24380 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 78 similar messages]
I20250109 21:11:45.388024 20003 tablet_replica.cc:331] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.389032 20003 raft_consensus.cc:2238] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus shutting down.
W20250109 21:11:45.389227 24380 consensus_peers.cc:487] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:45.389827 20003 raft_consensus.cc:2267] T 7944e0ea090a460db2c4f7b3d6be4a35 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.392490 20003 tablet_replica.cc:331] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.393190 20003 raft_consensus.cc:2238] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.393604 20003 raft_consensus.cc:2267] T 8adff09d64b444eabbb6a7bd0f97de6a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.396569 20003 tablet_replica.cc:331] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.397197 20003 raft_consensus.cc:2238] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.397754 20003 raft_consensus.cc:2267] T 5d6de8b7d8c94a9e961d7e1378867508 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.401021 20003 tablet_replica.cc:331] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.402004 20003 raft_consensus.cc:2238] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.402700 20003 raft_consensus.cc:2267] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.406419 20003 tablet_replica.cc:331] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.407217 20003 raft_consensus.cc:2238] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.407919 20003 raft_consensus.cc:2267] T 98a0770c333f4e0881b843f212d91888 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.410806 20003 tablet_replica.cc:331] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.411625 20003 raft_consensus.cc:2238] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.412313 20003 raft_consensus.cc:2267] T d6d844a03cb4427999b61cac0644403d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.415351 20003 tablet_replica.cc:331] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.416100 20003 raft_consensus.cc:2238] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.416641 20003 raft_consensus.cc:2267] T f578e2ab431947e0805d2c6967d43dc3 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.419962 20003 tablet_replica.cc:331] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.420811 20003 raft_consensus.cc:2238] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.421406 20003 raft_consensus.cc:2267] T 47768a3814874f04ac7599523949bd81 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.425073 20003 tablet_replica.cc:331] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.425812 20003 raft_consensus.cc:2238] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.426415 20003 raft_consensus.cc:2267] T 39f608b6f2484784be332e75fc641b47 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.429586 20003 tablet_replica.cc:331] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.430359 20003 raft_consensus.cc:2238] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.431001 20003 raft_consensus.cc:2267] T 1ef9bafd58c04d77b597d7dc1570df26 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.434260 20003 tablet_replica.cc:331] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.434991 20003 raft_consensus.cc:2238] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.435592 20003 raft_consensus.cc:2267] T c234860bfa0449b58932d751ed0c8e7d P 47125da93b0e4ef8b9e12cd10cd123b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.438715 20003 tablet_replica.cc:331] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.439486 20003 raft_consensus.cc:2238] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.440145 20003 raft_consensus.cc:2267] T 2695abb92d0b4ffab484d8559954101a P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.443226 20003 tablet_replica.cc:331] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.443960 20003 raft_consensus.cc:2238] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.444566 20003 raft_consensus.cc:2267] T 50630bfe825448bab1eaa3beb904b50b P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.447654 20003 tablet_replica.cc:331] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.448417 20003 raft_consensus.cc:2238] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.449076 20003 raft_consensus.cc:2267] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 47125da93b0e4ef8b9e12cd10cd123b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.452443 20003 tablet_replica.cc:331] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4: stopping tablet replica
I20250109 21:11:45.453150 20003 raft_consensus.cc:2238] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.453807 20003 raft_consensus.cc:2267] T 859d68415c0b4960b495b4ab9d067e3c P 47125da93b0e4ef8b9e12cd10cd123b4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:45.487720 24305 consensus_peers.cc:487] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:45.507581 24380 consensus_peers.cc:487] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:45.509636 24305 consensus_peers.cc:487] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:45.514037 20003 tablet_server.cc:195] TabletServer@127.19.136.193:0 shutdown complete.
W20250109 21:11:45.539727 24380 consensus_peers.cc:487] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:11:45.557996 24380 consensus_peers.cc:487] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:45.578578 20003 tablet_server.cc:178] TabletServer@127.19.136.194:0 shutting down...
I20250109 21:11:45.613148 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:11:45.614041 20003 tablet_replica.cc:331] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.615172 20003 raft_consensus.cc:2238] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.616382 20003 raft_consensus.cc:2267] T 1e6f26fa5c544ef7933cf72e192c178b P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.618961 20003 tablet_replica.cc:331] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.619529 20003 raft_consensus.cc:2238] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.620296 20003 raft_consensus.cc:2267] T 2019fe427a7d4c7fb03282c91b0d7176 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.622550 20003 tablet_replica.cc:331] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.623338 20003 raft_consensus.cc:2238] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.623907 20003 raft_consensus.cc:2267] T 5d6de8b7d8c94a9e961d7e1378867508 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.626624 20003 tablet_replica.cc:331] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.627574 20003 raft_consensus.cc:2238] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.628711 20003 raft_consensus.cc:2267] T 38a1ab3bdf884c52923588d4425c6632 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:45.628845 24380 consensus_peers.cc:487] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:45.631214 20003 tablet_replica.cc:331] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.631847 20003 raft_consensus.cc:2238] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.632304 20003 raft_consensus.cc:2267] T 7944e0ea090a460db2c4f7b3d6be4a35 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.634526 20003 tablet_replica.cc:331] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.635139 20003 raft_consensus.cc:2238] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.635782 20003 raft_consensus.cc:2267] T f578e2ab431947e0805d2c6967d43dc3 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.635784 24770 raft_consensus.cc:491] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:45.636615 24770 raft_consensus.cc:513] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:45.638700 20003 tablet_replica.cc:331] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.639200 24770 leader_election.cc:290] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:45.639575 20003 raft_consensus.cc:2238] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.640306 20003 raft_consensus.cc:2267] T 8adff09d64b444eabbb6a7bd0f97de6a P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:45.643574 24381 leader_election.cc:336] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250109 21:11:45.643796 24770 raft_consensus.cc:491] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:45.644870 20003 tablet_replica.cc:331] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.644572 24770 raft_consensus.cc:513] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
W20250109 21:11:45.645403 24380 leader_election.cc:336] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111)
I20250109 21:11:45.645812 20003 raft_consensus.cc:2238] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.645841 24380 leader_election.cc:304] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:45.646699 20003 raft_consensus.cc:2267] T 39f608b6f2484784be332e75fc641b47 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.646809 24751 raft_consensus.cc:2743] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:45.647104 24770 leader_election.cc:290] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:45.648128 24770 raft_consensus.cc:491] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:45.648785 24770 raft_consensus.cc:513] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } } peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } }
I20250109 21:11:45.650046 20003 tablet_replica.cc:331] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
W20250109 21:11:45.650578 24381 leader_election.cc:336] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250109 21:11:45.651055 24770 leader_election.cc:290] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 2 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
I20250109 21:11:45.651031 20003 raft_consensus.cc:2238] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.653137 20003 raft_consensus.cc:2267] T 47768a3814874f04ac7599523949bd81 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:45.653892 24381 leader_election.cc:336] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer
I20250109 21:11:45.656523 20003 tablet_replica.cc:331] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
W20250109 21:11:45.656515 24380 leader_election.cc:336] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111)
I20250109 21:11:45.657296 20003 raft_consensus.cc:2238] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.657155 24380 leader_election.cc:304] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:45.657946 20003 raft_consensus.cc:2267] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.657982 24770 raft_consensus.cc:2743] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250109 21:11:45.658176 24380 leader_election.cc:336] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 2 pre-election: RPC error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111)
I20250109 21:11:45.658785 24380 leader_election.cc:304] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 2 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:45.659529 24770 raft_consensus.cc:2743] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Leader pre-election lost for term 2. Reason: could not achieve majority
I20250109 21:11:45.661098 20003 tablet_replica.cc:331] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.661674 20003 raft_consensus.cc:2238] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.662511 20003 raft_consensus.cc:2267] T 859d68415c0b4960b495b4ab9d067e3c P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.664646 20003 tablet_replica.cc:331] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.665194 20003 raft_consensus.cc:2238] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.666465 20003 raft_consensus.cc:2267] T 2695abb92d0b4ffab484d8559954101a P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:45.669000 24381 consensus_peers.cc:487] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f -> Peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Couldn't send request to peer 31e6940413e84966ab39625aa5d4ccc5. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:45.669438 20003 tablet_replica.cc:331] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.670017 20003 raft_consensus.cc:2238] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.670449 20003 raft_consensus.cc:2267] T 50630bfe825448bab1eaa3beb904b50b P 31e6940413e84966ab39625aa5d4ccc5 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.672645 20003 tablet_replica.cc:331] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.673164 20003 raft_consensus.cc:2238] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.674108 20003 raft_consensus.cc:2267] T 1ef9bafd58c04d77b597d7dc1570df26 P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.676214 20003 tablet_replica.cc:331] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.676781 20003 raft_consensus.cc:2238] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.677269 20003 raft_consensus.cc:2267] T 98a0770c333f4e0881b843f212d91888 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.679283 20003 tablet_replica.cc:331] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.679759 20003 raft_consensus.cc:2238] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.680621 20003 raft_consensus.cc:2267] T d6d844a03cb4427999b61cac0644403d P 31e6940413e84966ab39625aa5d4ccc5 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.682526 20003 tablet_replica.cc:331] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.682998 20003 raft_consensus.cc:2238] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.683503 20003 raft_consensus.cc:2267] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.685566 20003 tablet_replica.cc:331] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5: stopping tablet replica
I20250109 21:11:45.685984 20003 raft_consensus.cc:2238] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.686462 20003 raft_consensus.cc:2267] T c234860bfa0449b58932d751ed0c8e7d P 31e6940413e84966ab39625aa5d4ccc5 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:45.701431 24380 consensus_peers.cc:487] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:45.711570 24770 raft_consensus.cc:491] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:45.712373 24770 raft_consensus.cc:513] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:45.718392 24770 leader_election.cc:290] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
W20250109 21:11:45.718533 24381 leader_election.cc:336] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Network error: recv got EOF from unknown peer (error 108)
W20250109 21:11:45.720697 24380 leader_election.cc:336] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111)
I20250109 21:11:45.721243 24380 leader_election.cc:304] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:45.722136 24770 raft_consensus.cc:2743] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
I20250109 21:11:45.722728 20003 tablet_server.cc:195] TabletServer@127.19.136.194:0 shutdown complete.
I20250109 21:11:45.763109 24770 raft_consensus.cc:491] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election (detected failure of leader 47125da93b0e4ef8b9e12cd10cd123b4)
I20250109 21:11:45.763883 24770 raft_consensus.cc:513] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "47125da93b0e4ef8b9e12cd10cd123b4" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 42407 } } peers { permanent_uuid: "31e6940413e84966ab39625aa5d4ccc5" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 45507 } } peers { permanent_uuid: "90c75ac1abda40fd952cb7d88c7d753f" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 34483 } }
I20250109 21:11:45.766316 20003 tablet_server.cc:178] TabletServer@127.19.136.195:0 shutting down...
I20250109 21:11:45.769809 24770 leader_election.cc:290] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Requested pre-vote from peers 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407), 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507)
W20250109 21:11:45.775784 24380 leader_election.cc:336] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111)
W20250109 21:11:45.779062 24381 leader_election.cc:336] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: RPC error from VoteRequest() call to peer 31e6940413e84966ab39625aa5d4ccc5 (127.19.136.194:45507): Network error: Client connection negotiation failed: client connection to 127.19.136.194:45507: connect: Connection refused (error 111)
I20250109 21:11:45.779480 24381 leader_election.cc:304] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [CANDIDATE]: Term 3 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 90c75ac1abda40fd952cb7d88c7d753f; no voters: 31e6940413e84966ab39625aa5d4ccc5, 47125da93b0e4ef8b9e12cd10cd123b4
I20250109 21:11:45.780261 24770 raft_consensus.cc:2743] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Leader pre-election lost for term 3. Reason: could not achieve majority
W20250109 21:11:45.806818 24380 consensus_peers.cc:487] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f -> Peer 47125da93b0e4ef8b9e12cd10cd123b4 (127.19.136.193:42407): Couldn't send request to peer 47125da93b0e4ef8b9e12cd10cd123b4. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:42407: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:11:45.810120 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:11:45.810986 20003 tablet_replica.cc:331] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.812239 20003 raft_consensus.cc:2238] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.813083 20003 raft_consensus.cc:2267] T 1e6f26fa5c544ef7933cf72e192c178b P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.815444 20003 tablet_replica.cc:331] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.816030 20003 raft_consensus.cc:2238] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.816538 20003 raft_consensus.cc:2267] T f578e2ab431947e0805d2c6967d43dc3 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.818632 20003 tablet_replica.cc:331] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.819250 20003 raft_consensus.cc:2238] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.820113 20003 raft_consensus.cc:2267] T 7944e0ea090a460db2c4f7b3d6be4a35 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.821998 20003 tablet_replica.cc:331] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.822539 20003 raft_consensus.cc:2238] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.823006 20003 raft_consensus.cc:2267] T 38a1ab3bdf884c52923588d4425c6632 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.825186 20003 tablet_replica.cc:331] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.825747 20003 raft_consensus.cc:2238] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.826597 20003 raft_consensus.cc:2267] T 2019fe427a7d4c7fb03282c91b0d7176 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.828744 20003 tablet_replica.cc:331] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.829284 20003 raft_consensus.cc:2238] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.829885 20003 raft_consensus.cc:2267] T 5d6de8b7d8c94a9e961d7e1378867508 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.832592 20003 tablet_replica.cc:331] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.833340 20003 raft_consensus.cc:2238] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.834096 20003 raft_consensus.cc:2267] T 8adff09d64b444eabbb6a7bd0f97de6a P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.836993 20003 tablet_replica.cc:331] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.837589 20003 raft_consensus.cc:2238] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.838402 20003 raft_consensus.cc:2267] T 47768a3814874f04ac7599523949bd81 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.840350 20003 tablet_replica.cc:331] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.840838 20003 raft_consensus.cc:2238] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.841248 20003 raft_consensus.cc:2267] T 39f608b6f2484784be332e75fc641b47 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.843315 20003 tablet_replica.cc:331] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.843963 20003 raft_consensus.cc:2238] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.844414 20003 raft_consensus.cc:2267] T c234860bfa0449b58932d751ed0c8e7d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.846437 20003 tablet_replica.cc:331] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.846964 20003 raft_consensus.cc:2238] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.847393 20003 raft_consensus.cc:2267] T d6d844a03cb4427999b61cac0644403d P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.849555 20003 tablet_replica.cc:331] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.849997 20003 raft_consensus.cc:2238] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.850445 20003 raft_consensus.cc:2267] T 98a0770c333f4e0881b843f212d91888 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.852394 20003 tablet_replica.cc:331] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.852849 20003 raft_consensus.cc:2238] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.853262 20003 raft_consensus.cc:2267] T 1ef9bafd58c04d77b597d7dc1570df26 P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.855105 20003 tablet_replica.cc:331] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.855604 20003 raft_consensus.cc:2238] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.856096 20003 raft_consensus.cc:2267] T 2695abb92d0b4ffab484d8559954101a P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.857970 20003 tablet_replica.cc:331] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.858434 20003 raft_consensus.cc:2238] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.859318 20003 raft_consensus.cc:2267] T 50630bfe825448bab1eaa3beb904b50b P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.861193 20003 tablet_replica.cc:331] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.861645 20003 raft_consensus.cc:2238] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.862471 20003 raft_consensus.cc:2267] T d58d0e7f91b54d7cbbdbb2dd51ae5c28 P 90c75ac1abda40fd952cb7d88c7d753f [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.864449 20003 tablet_replica.cc:331] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.864974 20003 raft_consensus.cc:2238] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:11:45.865399 20003 raft_consensus.cc:2267] T 859d68415c0b4960b495b4ab9d067e3c P 90c75ac1abda40fd952cb7d88c7d753f [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:45.867297 20003 tablet_replica.cc:331] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f: stopping tablet replica
I20250109 21:11:45.867703 20003 raft_consensus.cc:2238] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:11:45.868492 20003 raft_consensus.cc:2267] T 691aaa81f1d6437da0eb8c8ec267a1a2 P 90c75ac1abda40fd952cb7d88c7d753f [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:11:46.908198 20003 thread.cc:535] Waited for 1000ms trying to join with diag-logger (tid 24437)
I20250109 21:11:47.468550 20003 tablet_server.cc:195] TabletServer@127.19.136.195:0 shutdown complete.
I20250109 21:11:47.501144 20003 master.cc:537] Master@127.19.136.254:46761 shutting down...
I20250109 21:11:47.523185 20003 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:11:47.523713 20003 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:11:47.524024 20003 tablet_replica.cc:331] T 00000000000000000000000000000000 P 3e7db19cc9f14bee9bd06ea2bb4bbaac: stopping tablet replica
I20250109 21:11:47.543452 20003 master.cc:559] Master@127.19.136.254:46761 shutdown complete.
I20250109 21:11:47.572458 20003 test_util.cc:181] -----------------------------------------------
I20250109 21:11:47.572635 20003 test_util.cc:182] Had failures, leaving test files at /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_0.1736456943481041-20003-0
[ FAILED ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0, where GetParam() = false (23043 ms)
[ RUN ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1
I20250109 21:11:47.575405 20003 internal_mini_cluster.cc:156] Creating distributed mini masters. Addrs: 127.19.136.254:38067
I20250109 21:11:47.576339 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:47.581606 24779 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:47.582296 24780 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:47.583115 24782 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:47.583516 20003 server_base.cc:1034] running on GCE node
I20250109 21:11:47.584492 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:11:47.584682 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:47.584821 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457107584803 us; error 0 us; skew 500 ppm
I20250109 21:11:47.585265 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:11:47.594391 20003 webserver.cc:458] Webserver started at http://127.19.136.254:41827/ using document root <none> and password file <none>
I20250109 21:11:47.594844 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:11:47.595052 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:11:47.595362 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:11:47.596486 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/master-0-root/instance:
uuid: "67307ee40f1a4b0690ae46dbd071f7c7"
format_stamp: "Formatted at 2025-01-09 21:11:47 on dist-test-slave-sc47"
I20250109 21:11:47.600559 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.005s sys 0.000s
I20250109 21:11:47.603550 24787 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:47.604197 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:11:47.604440 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/master-0-root
uuid: "67307ee40f1a4b0690ae46dbd071f7c7"
format_stamp: "Formatted at 2025-01-09 21:11:47 on dist-test-slave-sc47"
I20250109 21:11:47.604676 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/master-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/master-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/master-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:11:47.619527 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:47.620605 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:47.656549 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.254:38067
I20250109 21:11:47.656661 24839 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.254:38067 every 8 connection(s)
I20250109 21:11:47.660156 24840 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 00000000000000000000000000000000. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:47.671043 24840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7: Bootstrap starting.
I20250109 21:11:47.675546 24840 tablet_bootstrap.cc:654] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:47.679255 24840 tablet_bootstrap.cc:492] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7: No bootstrap required, opened a new log
I20250109 21:11:47.681114 24840 raft_consensus.cc:357] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67307ee40f1a4b0690ae46dbd071f7c7" member_type: VOTER }
I20250109 21:11:47.681459 24840 raft_consensus.cc:383] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:47.681629 24840 raft_consensus.cc:738] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 67307ee40f1a4b0690ae46dbd071f7c7, State: Initialized, Role: FOLLOWER
I20250109 21:11:47.682160 24840 consensus_queue.cc:260] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67307ee40f1a4b0690ae46dbd071f7c7" member_type: VOTER }
I20250109 21:11:47.682572 24840 raft_consensus.cc:397] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 0 FOLLOWER]: Only one voter in the Raft config. Triggering election immediately
I20250109 21:11:47.682763 24840 raft_consensus.cc:491] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 0 FOLLOWER]: Starting leader election (initial election of a single-replica configuration)
I20250109 21:11:47.683009 24840 raft_consensus.cc:3054] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:47.687515 24840 raft_consensus.cc:513] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67307ee40f1a4b0690ae46dbd071f7c7" member_type: VOTER }
I20250109 21:11:47.687947 24840 leader_election.cc:304] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 1 responses out of 1 voters: 1 yes votes; 0 no votes. yes voters: 67307ee40f1a4b0690ae46dbd071f7c7; no voters:
I20250109 21:11:47.688877 24840 leader_election.cc:290] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [CANDIDATE]: Term 1 election: Requested vote from peers
I20250109 21:11:47.689226 24843 raft_consensus.cc:2798] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:47.690505 24843 raft_consensus.cc:695] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 1 LEADER]: Becoming Leader. State: Replica: 67307ee40f1a4b0690ae46dbd071f7c7, State: Running, Role: LEADER
I20250109 21:11:47.691190 24843 consensus_queue.cc:237] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 1, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67307ee40f1a4b0690ae46dbd071f7c7" member_type: VOTER }
I20250109 21:11:47.691689 24840 sys_catalog.cc:564] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [sys.catalog]: configured and running, proceeding with master startup.
I20250109 21:11:47.695248 24844 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [sys.catalog]: SysCatalogTable state changed. Reason: RaftConsensus started. Latest consensus state: current_term: 1 leader_uuid: "67307ee40f1a4b0690ae46dbd071f7c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67307ee40f1a4b0690ae46dbd071f7c7" member_type: VOTER } }
I20250109 21:11:47.696072 24845 sys_catalog.cc:455] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [sys.catalog]: SysCatalogTable state changed. Reason: New leader 67307ee40f1a4b0690ae46dbd071f7c7. Latest consensus state: current_term: 1 leader_uuid: "67307ee40f1a4b0690ae46dbd071f7c7" committed_config { opid_index: -1 OBSOLETE_local: true peers { permanent_uuid: "67307ee40f1a4b0690ae46dbd071f7c7" member_type: VOTER } }
I20250109 21:11:47.696591 24844 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [sys.catalog]: This master's current role is: LEADER
I20250109 21:11:47.696734 24845 sys_catalog.cc:458] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [sys.catalog]: This master's current role is: LEADER
I20250109 21:11:47.703933 24851 catalog_manager.cc:1476] Loading table and tablet metadata into memory...
I20250109 21:11:47.708719 24851 catalog_manager.cc:1485] Initializing Kudu cluster ID...
I20250109 21:11:47.709758 20003 internal_mini_cluster.cc:184] Waiting to initialize catalog manager on master 0
I20250109 21:11:47.716909 24851 catalog_manager.cc:1348] Generated new cluster ID: 654b8a01fc49419b8a87ec582e214f28
I20250109 21:11:47.717177 24851 catalog_manager.cc:1496] Initializing Kudu internal certificate authority...
I20250109 21:11:47.729960 24851 catalog_manager.cc:1371] Generated new certificate authority record
I20250109 21:11:47.731192 24851 catalog_manager.cc:1505] Loading token signing keys...
I20250109 21:11:47.744613 24851 catalog_manager.cc:5899] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7: Generated new TSK 0
I20250109 21:11:47.745151 24851 catalog_manager.cc:1515] Initializing in-progress tserver states...
I20250109 21:11:47.776073 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:47.781935 24861 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:47.782729 24862 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:47.783942 20003 server_base.cc:1034] running on GCE node
W20250109 21:11:47.784875 24864 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:47.785748 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:11:47.785945 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:47.786093 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457107786076 us; error 0 us; skew 500 ppm
I20250109 21:11:47.786584 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:11:47.788807 20003 webserver.cc:458] Webserver started at http://127.19.136.193:39199/ using document root <none> and password file <none>
I20250109 21:11:47.789252 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:11:47.789430 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:11:47.789666 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:11:47.790788 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-0-root/instance:
uuid: "ef0ecd709a624128b4513100dfc72fc6"
format_stamp: "Formatted at 2025-01-09 21:11:47 on dist-test-slave-sc47"
I20250109 21:11:47.794883 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.001s
I20250109 21:11:47.797760 24869 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:47.798395 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:11:47.798648 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-0-root
uuid: "ef0ecd709a624128b4513100dfc72fc6"
format_stamp: "Formatted at 2025-01-09 21:11:47 on dist-test-slave-sc47"
I20250109 21:11:47.798934 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-0-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-0-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-0-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:11:47.821648 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:47.822818 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:47.824291 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:11:47.826411 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:11:47.826607 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:47.826828 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:11:47.826992 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.001s sys 0.000s
I20250109 21:11:47.865281 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.193:46187
I20250109 21:11:47.865377 24932 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.193:46187 every 8 connection(s)
I20250109 21:11:47.870066 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:47.877622 24937 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:47.878754 24938 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:47.882169 24940 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:47.882416 24933 heartbeater.cc:346] Connected to a master server at 127.19.136.254:38067
I20250109 21:11:47.882840 24933 heartbeater.cc:463] Registering TS with master...
I20250109 21:11:47.883226 20003 server_base.cc:1034] running on GCE node
I20250109 21:11:47.883692 24933 heartbeater.cc:510] Master 127.19.136.254:38067 requested a full tablet report, sending...
I20250109 21:11:47.884420 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
W20250109 21:11:47.884660 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:47.884835 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457107884813 us; error 0 us; skew 500 ppm
I20250109 21:11:47.885360 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:11:47.885556 24805 ts_manager.cc:194] Registered new tserver with Master: ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187)
I20250109 21:11:47.887621 24805 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54288
I20250109 21:11:47.888003 20003 webserver.cc:458] Webserver started at http://127.19.136.194:34181/ using document root <none> and password file <none>
I20250109 21:11:47.888509 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:11:47.888690 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:11:47.888943 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:11:47.890074 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-1-root/instance:
uuid: "4841879f5e4347918a29b974a7cadd49"
format_stamp: "Formatted at 2025-01-09 21:11:47 on dist-test-slave-sc47"
I20250109 21:11:47.894287 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.002s sys 0.004s
I20250109 21:11:47.897315 24945 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:47.897982 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.002s sys 0.000s
I20250109 21:11:47.898238 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-1-root
uuid: "4841879f5e4347918a29b974a7cadd49"
format_stamp: "Formatted at 2025-01-09 21:11:47 on dist-test-slave-sc47"
I20250109 21:11:47.898500 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-1-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-1-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-1-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:11:47.912748 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:47.913782 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:47.915242 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:11:47.917224 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:11:47.917403 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:47.917642 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:11:47.917788 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:47.956436 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.194:34007
I20250109 21:11:47.956539 25007 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.194:34007 every 8 connection(s)
I20250109 21:11:47.960862 20003 file_cache.cc:492] Constructed file cache file cache with capacity 419430
W20250109 21:11:47.967847 25011 instance_detector.cc:116] could not retrieve AWS instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:47.970840 25012 instance_detector.cc:116] could not retrieve Azure instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
W20250109 21:11:47.971529 25014 instance_detector.cc:116] could not retrieve OpenStack instance metadata: Network error: curl error: HTTP response code said error: The requested URL returned error: 404
I20250109 21:11:47.972674 20003 server_base.cc:1034] running on GCE node
I20250109 21:11:47.973383 25008 heartbeater.cc:346] Connected to a master server at 127.19.136.254:38067
I20250109 21:11:47.973719 20003 hybrid_clock.cc:584] initializing the hybrid clock with 'system_unsync' time source
I20250109 21:11:47.973855 25008 heartbeater.cc:463] Registering TS with master...
W20250109 21:11:47.974053 20003 system_unsync_time.cc:38] NTP support is disabled. Clock error bounds will not be accurate. This configuration is not suitable for distributed clusters.
I20250109 21:11:47.974273 20003 hybrid_clock.cc:648] HybridClock initialized: now 1736457107974253 us; error 0 us; skew 500 ppm
I20250109 21:11:47.974782 25008 heartbeater.cc:510] Master 127.19.136.254:38067 requested a full tablet report, sending...
I20250109 21:11:47.975113 20003 server_base.cc:834] Flag tcmalloc_max_total_thread_cache_bytes is not working since tcmalloc is not enabled.
I20250109 21:11:47.976985 24805 ts_manager.cc:194] Registered new tserver with Master: 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:47.977952 20003 webserver.cc:458] Webserver started at http://127.19.136.195:45581/ using document root <none> and password file <none>
I20250109 21:11:47.978602 20003 fs_manager.cc:362] Metadata directory not provided
I20250109 21:11:47.978827 20003 fs_manager.cc:368] Using write-ahead log directory (fs_wal_dir) as metadata directory
I20250109 21:11:47.978818 24805 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54300
I20250109 21:11:47.979390 20003 server_base.cc:882] This appears to be a new deployment of Kudu; creating new FS layout
I20250109 21:11:47.980938 20003 fs_manager.cc:1068] Generated new instance metadata in path /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-2-root/instance:
uuid: "5623262d5bc949f7907acb0a7215d9b4"
format_stamp: "Formatted at 2025-01-09 21:11:47 on dist-test-slave-sc47"
I20250109 21:11:47.985167 20003 fs_manager.cc:696] Time spent creating directory manager: real 0.004s user 0.006s sys 0.000s
I20250109 21:11:47.988119 25019 log_block_manager.cc:3788] Time spent loading block containers with low live blocks: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:47.988757 20003 fs_manager.cc:730] Time spent opening block manager: real 0.002s user 0.003s sys 0.000s
I20250109 21:11:47.989030 20003 fs_manager.cc:647] Opened local filesystem: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-2-root
uuid: "5623262d5bc949f7907acb0a7215d9b4"
format_stamp: "Formatted at 2025-01-09 21:11:47 on dist-test-slave-sc47"
I20250109 21:11:47.989240 20003 fs_report.cc:389] FS layout report
--------------------
wal directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-2-root
metadata directory: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-2-root
1 data directories: /tmp/dist-test-taskdU3wNM/test-tmp/auto_leader_rebalancer-test.0.FilterSoftDeletedTableTest.TestFilterSofteDeletedTable_1.1736456943481041-20003-0/minicluster-data/ts-2-root/data
Total live blocks: 0
Total live bytes: 0
Total live bytes (after alignment): 0
Total number of LBM containers: 0 (0 full)
Did not check for missing blocks
Did not check for orphaned blocks
Total full LBM containers with extra space: 0 (0 repaired)
Total full LBM container extra space in bytes: 0 (0 repaired)
Total incomplete LBM containers: 0 (0 repaired)
Total LBM partial records: 0 (0 repaired)
Total corrupted LBM metadata records in RocksDB: 0 (0 repaired)
I20250109 21:11:48.010864 20003 rpc_server.cc:225] running with OpenSSL 1.1.1 11 Sep 2018
I20250109 21:11:48.011889 20003 kserver.cc:163] Server-wide thread pool size limit: 3276
I20250109 21:11:48.013269 20003 txn_system_client.cc:432] TxnSystemClient initialization is disabled...
I20250109 21:11:48.015329 20003 ts_tablet_manager.cc:579] Loaded tablet metadata (0 total tablets, 0 live tablets)
I20250109 21:11:48.015512 20003 ts_tablet_manager.cc:525] Time spent load tablet metadata: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:48.015713 20003 ts_tablet_manager.cc:610] Registered 0 tablets
I20250109 21:11:48.015846 20003 ts_tablet_manager.cc:589] Time spent register tablets: real 0.000s user 0.000s sys 0.000s
I20250109 21:11:48.053028 20003 rpc_server.cc:307] RPC server started. Bound to: 127.19.136.195:44027
I20250109 21:11:48.053122 25083 acceptor_pool.cc:272] collecting diagnostics on the listening RPC socket 127.19.136.195:44027 every 8 connection(s)
I20250109 21:11:48.065418 25084 heartbeater.cc:346] Connected to a master server at 127.19.136.254:38067
I20250109 21:11:48.065822 25084 heartbeater.cc:463] Registering TS with master...
I20250109 21:11:48.066457 25084 heartbeater.cc:510] Master 127.19.136.254:38067 requested a full tablet report, sending...
I20250109 21:11:48.068099 24805 ts_manager.cc:194] Registered new tserver with Master: 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.069108 20003 internal_mini_cluster.cc:371] 3 TS(s) registered with all masters after 0.013103832s
I20250109 21:11:48.069407 24805 master_service.cc:496] Signed X509 certificate for tserver {username='slave'} at 127.0.0.1:54312
I20250109 21:11:48.071236 20003 test_util.cc:274] Using random seed: 1830298417
I20250109 21:11:48.091591 24805 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54318:
name: "test-workload"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250109 21:11:48.094236 24805 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table test-workload in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250109 21:11:48.154358 24898 tablet_service.cc:1467] Processing CreateTablet for tablet c61207388546489497ba5192615f7ddc (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:48.155128 24893 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe14f975aa84664bb0ed6080d7c89e4 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:48.155797 24898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61207388546489497ba5192615f7ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.156555 24893 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe14f975aa84664bb0ed6080d7c89e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.157913 24897 tablet_service.cc:1467] Processing CreateTablet for tablet b0708b4b9a5c43959b1b3d303115fad9 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:48.159212 24897 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0708b4b9a5c43959b1b3d303115fad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.161198 24896 tablet_service.cc:1467] Processing CreateTablet for tablet 4df8bcc17f3d4430b1eebf02c2e60c52 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:48.162303 25043 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe14f975aa84664bb0ed6080d7c89e4 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:48.163676 25043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe14f975aa84664bb0ed6080d7c89e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.163594 24895 tablet_service.cc:1467] Processing CreateTablet for tablet 36bf434726e740a1a55bb757ea6c7a04 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:48.165805 25048 tablet_service.cc:1467] Processing CreateTablet for tablet c61207388546489497ba5192615f7ddc (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:48.167033 24892 tablet_service.cc:1467] Processing CreateTablet for tablet e2c33c211712430888fa872f1226d799 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:48.167068 25048 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61207388546489497ba5192615f7ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.169266 25044 tablet_service.cc:1467] Processing CreateTablet for tablet 36bf434726e740a1a55bb757ea6c7a04 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:48.170473 25044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bf434726e740a1a55bb757ea6c7a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.172102 25042 tablet_service.cc:1467] Processing CreateTablet for tablet e2c33c211712430888fa872f1226d799 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:48.173522 25042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c33c211712430888fa872f1226d799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.168198 25047 tablet_service.cc:1467] Processing CreateTablet for tablet b0708b4b9a5c43959b1b3d303115fad9 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:48.172039 25045 tablet_service.cc:1467] Processing CreateTablet for tablet 4df8bcc17f3d4430b1eebf02c2e60c52 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:48.175068 25047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0708b4b9a5c43959b1b3d303115fad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.175256 24892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c33c211712430888fa872f1226d799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.175853 25045 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df8bcc17f3d4430b1eebf02c2e60c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.179039 24896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df8bcc17f3d4430b1eebf02c2e60c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.183270 24895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bf434726e740a1a55bb757ea6c7a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.184222 24973 tablet_service.cc:1467] Processing CreateTablet for tablet c61207388546489497ba5192615f7ddc (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:48.185473 24973 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet c61207388546489497ba5192615f7ddc. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.192250 25041 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2535f2645d4849b03aeeb84682f73e (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:48.193563 25041 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e2535f2645d4849b03aeeb84682f73e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.192256 24972 tablet_service.cc:1467] Processing CreateTablet for tablet b0708b4b9a5c43959b1b3d303115fad9 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:48.196250 24972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet b0708b4b9a5c43959b1b3d303115fad9. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.196738 24971 tablet_service.cc:1467] Processing CreateTablet for tablet 4df8bcc17f3d4430b1eebf02c2e60c52 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:48.198140 24971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4df8bcc17f3d4430b1eebf02c2e60c52. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.207758 24891 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2535f2645d4849b03aeeb84682f73e (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:48.209080 24891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e2535f2645d4849b03aeeb84682f73e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.215018 24970 tablet_service.cc:1467] Processing CreateTablet for tablet 36bf434726e740a1a55bb757ea6c7a04 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:48.216274 24970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 36bf434726e740a1a55bb757ea6c7a04. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.219898 24969 tablet_service.cc:1467] Processing CreateTablet for tablet 8fe14f975aa84664bb0ed6080d7c89e4 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:48.221138 24969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8fe14f975aa84664bb0ed6080d7c89e4. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.224089 24968 tablet_service.cc:1467] Processing CreateTablet for tablet e2c33c211712430888fa872f1226d799 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:48.225335 24968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e2c33c211712430888fa872f1226d799. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.228075 24967 tablet_service.cc:1467] Processing CreateTablet for tablet 8e2535f2645d4849b03aeeb84682f73e (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:48.229348 24967 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 8e2535f2645d4849b03aeeb84682f73e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.237526 24890 tablet_service.cc:1467] Processing CreateTablet for tablet 3b36c529424042cca5930cbea746ee97 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:48.241670 24966 tablet_service.cc:1467] Processing CreateTablet for tablet 3b36c529424042cca5930cbea746ee97 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:48.245764 25040 tablet_service.cc:1467] Processing CreateTablet for tablet 3b36c529424042cca5930cbea746ee97 (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:48.247126 25040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b36c529424042cca5930cbea746ee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.238797 24890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b36c529424042cca5930cbea746ee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.248955 24966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3b36c529424042cca5930cbea746ee97. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.278805 24965 tablet_service.cc:1467] Processing CreateTablet for tablet e7c28f7e01f64c90a201ea5904bb178f (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:48.280180 24965 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c28f7e01f64c90a201ea5904bb178f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.292363 25039 tablet_service.cc:1467] Processing CreateTablet for tablet e7c28f7e01f64c90a201ea5904bb178f (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:48.293722 25039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c28f7e01f64c90a201ea5904bb178f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.293954 24895 tablet_service.cc:1467] Processing CreateTablet for tablet e7c28f7e01f64c90a201ea5904bb178f (DEFAULT_TABLE table=test-workload [id=d188b354c5ae46aa8adef3dae8c2e017]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:48.295511 24895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e7c28f7e01f64c90a201ea5904bb178f. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:48.331686 25101 tablet_bootstrap.cc:492] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.336795 25099 tablet_bootstrap.cc:492] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.337927 25101 tablet_bootstrap.cc:654] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.342268 25099 tablet_bootstrap.cc:654] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.369735 25100 tablet_bootstrap.cc:492] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.372972 25099 tablet_bootstrap.cc:492] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.373582 25099 ts_tablet_manager.cc:1397] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.037s user 0.012s sys 0.000s
I20250109 21:11:48.376482 25099 raft_consensus.cc:357] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.381670 25099 raft_consensus.cc:383] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.382025 25099 raft_consensus.cc:738] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.382319 25101 tablet_bootstrap.cc:492] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.383375 25101 ts_tablet_manager.cc:1397] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.052s user 0.016s sys 0.026s
I20250109 21:11:48.383476 25099 consensus_queue.cc:260] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.386018 24933 heartbeater.cc:502] Master 127.19.136.254:38067 was elected leader, sending a full tablet report...
I20250109 21:11:48.386795 25100 tablet_bootstrap.cc:654] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.386549 25101 raft_consensus.cc:357] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.387472 25101 raft_consensus.cc:383] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.387802 25101 raft_consensus.cc:738] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.388504 25101 consensus_queue.cc:260] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.391069 25099 ts_tablet_manager.cc:1428] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.017s user 0.007s sys 0.000s
I20250109 21:11:48.392045 25099 tablet_bootstrap.cc:492] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.396477 25084 heartbeater.cc:502] Master 127.19.136.254:38067 was elected leader, sending a full tablet report...
I20250109 21:11:48.397642 25101 ts_tablet_manager.cc:1428] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
I20250109 21:11:48.398491 25099 tablet_bootstrap.cc:654] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.398598 25101 tablet_bootstrap.cc:492] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.404969 25101 tablet_bootstrap.cc:654] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.406414 25100 tablet_bootstrap.cc:492] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.407064 25100 ts_tablet_manager.cc:1397] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.037s user 0.011s sys 0.000s
I20250109 21:11:48.409862 25100 raft_consensus.cc:357] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.410559 25100 raft_consensus.cc:383] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.410818 25100 raft_consensus.cc:738] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.411543 25100 consensus_queue.cc:260] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.413592 25008 heartbeater.cc:502] Master 127.19.136.254:38067 was elected leader, sending a full tablet report...
I20250109 21:11:48.416540 25101 tablet_bootstrap.cc:492] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.417034 25101 ts_tablet_manager.cc:1397] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.019s user 0.008s sys 0.008s
I20250109 21:11:48.419799 25101 raft_consensus.cc:357] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.420488 25101 raft_consensus.cc:383] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.420742 25101 raft_consensus.cc:738] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.421545 25101 consensus_queue.cc:260] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.424072 25101 ts_tablet_manager.cc:1428] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20250109 21:11:48.424819 25101 tablet_bootstrap.cc:492] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.428113 25100 ts_tablet_manager.cc:1428] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20250109 21:11:48.429246 25100 tablet_bootstrap.cc:492] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.430229 25101 tablet_bootstrap.cc:654] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.432721 25099 tablet_bootstrap.cc:492] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.433225 25099 ts_tablet_manager.cc:1397] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.041s user 0.008s sys 0.004s
I20250109 21:11:48.435583 25101 tablet_bootstrap.cc:492] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.436043 25101 ts_tablet_manager.cc:1397] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.011s user 0.006s sys 0.003s
I20250109 21:11:48.436218 25099 raft_consensus.cc:357] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.437144 25099 raft_consensus.cc:383] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.438800 25101 raft_consensus.cc:357] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.439306 25099 raft_consensus.cc:738] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.439695 25101 raft_consensus.cc:383] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.440032 25101 raft_consensus.cc:738] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.440117 25099 consensus_queue.cc:260] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.440824 25101 consensus_queue.cc:260] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.442597 25099 ts_tablet_manager.cc:1428] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.009s user 0.006s sys 0.001s
I20250109 21:11:48.443502 25099 tablet_bootstrap.cc:492] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.443766 25100 tablet_bootstrap.cc:654] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.445439 25101 ts_tablet_manager.cc:1428] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250109 21:11:48.446421 25101 tablet_bootstrap.cc:492] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.450505 25099 tablet_bootstrap.cc:654] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.457818 25101 tablet_bootstrap.cc:654] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.461624 25100 tablet_bootstrap.cc:492] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.462240 25100 ts_tablet_manager.cc:1397] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.033s user 0.013s sys 0.005s
I20250109 21:11:48.465381 25099 tablet_bootstrap.cc:492] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.465126 25100 raft_consensus.cc:357] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.465790 25099 ts_tablet_manager.cc:1397] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.022s user 0.006s sys 0.008s
I20250109 21:11:48.465883 25100 raft_consensus.cc:383] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.466238 25100 raft_consensus.cc:738] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.466336 25101 tablet_bootstrap.cc:492] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.466845 25101 ts_tablet_manager.cc:1397] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.021s user 0.014s sys 0.000s
I20250109 21:11:48.467029 25100 consensus_queue.cc:260] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.468078 25099 raft_consensus.cc:357] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.468799 25099 raft_consensus.cc:383] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.469082 25099 raft_consensus.cc:738] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.469331 25100 ts_tablet_manager.cc:1428] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250109 21:11:48.469578 25101 raft_consensus.cc:357] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.469745 25099 consensus_queue.cc:260] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.470440 25100 tablet_bootstrap.cc:492] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.470413 25101 raft_consensus.cc:383] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.470892 25101 raft_consensus.cc:738] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.471642 25101 consensus_queue.cc:260] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.475657 25101 ts_tablet_manager.cc:1428] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:11:48.476558 25101 tablet_bootstrap.cc:492] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.477269 25099 ts_tablet_manager.cc:1428] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.011s user 0.007s sys 0.001s
I20250109 21:11:48.479385 25099 tablet_bootstrap.cc:492] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.482549 25101 tablet_bootstrap.cc:654] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.483920 25100 tablet_bootstrap.cc:654] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.490124 25099 tablet_bootstrap.cc:654] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.494239 25100 tablet_bootstrap.cc:492] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.494838 25100 ts_tablet_manager.cc:1397] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.025s user 0.006s sys 0.008s
I20250109 21:11:48.497274 25101 tablet_bootstrap.cc:492] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.497285 25099 tablet_bootstrap.cc:492] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.497898 25101 ts_tablet_manager.cc:1397] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.010s
I20250109 21:11:48.497974 25099 ts_tablet_manager.cc:1397] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.019s user 0.010s sys 0.000s
I20250109 21:11:48.497417 25100 raft_consensus.cc:357] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.498386 25100 raft_consensus.cc:383] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.498703 25100 raft_consensus.cc:738] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.499575 25100 consensus_queue.cc:260] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.500300 25099 raft_consensus.cc:357] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.501029 25099 raft_consensus.cc:383] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.500737 25101 raft_consensus.cc:357] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.501299 25099 raft_consensus.cc:738] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.501446 25101 raft_consensus.cc:383] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.501812 25101 raft_consensus.cc:738] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.501881 25100 ts_tablet_manager.cc:1428] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:11:48.502086 25099 consensus_queue.cc:260] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.502986 25100 tablet_bootstrap.cc:492] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.502715 25101 consensus_queue.cc:260] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.505141 25101 ts_tablet_manager.cc:1428] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.007s user 0.005s sys 0.000s
I20250109 21:11:48.506145 25101 tablet_bootstrap.cc:492] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.512480 25100 tablet_bootstrap.cc:654] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.512833 25099 ts_tablet_manager.cc:1428] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.014s user 0.000s sys 0.005s
I20250109 21:11:48.513015 25101 tablet_bootstrap.cc:654] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.514195 25106 raft_consensus.cc:491] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.514642 25106 raft_consensus.cc:513] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.517134 25106 leader_election.cc:290] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:48.519824 25099 tablet_bootstrap.cc:492] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.526511 25099 tablet_bootstrap.cc:654] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.537945 25099 tablet_bootstrap.cc:492] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.538305 25099 ts_tablet_manager.cc:1397] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.019s user 0.007s sys 0.009s
I20250109 21:11:48.538535 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
W20250109 21:11:48.540690 25020 leader_election.cc:343] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.541013 25099 raft_consensus.cc:357] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.541674 25099 raft_consensus.cc:383] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.541919 25099 raft_consensus.cc:738] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.542502 25099 consensus_queue.cc:260] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.546329 25099 ts_tablet_manager.cc:1428] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.008s user 0.007s sys 0.000s
I20250109 21:11:48.547291 25099 tablet_bootstrap.cc:492] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.548044 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:48.548558 25109 raft_consensus.cc:491] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.549070 25109 raft_consensus.cc:513] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
W20250109 21:11:48.550011 25020 leader_election.cc:343] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.550607 25020 leader_election.cc:304] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4; no voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:48.551715 25106 raft_consensus.cc:2743] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:48.553603 25099 tablet_bootstrap.cc:654] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.553802 25104 raft_consensus.cc:491] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.554255 25104 raft_consensus.cc:513] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.556129 25106 raft_consensus.cc:491] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.556761 25106 raft_consensus.cc:513] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.558008 25104 leader_election.cc:290] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.562494 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:48.563400 24983 raft_consensus.cc:2463] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:48.564348 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:48.564937 25020 leader_election.cc:304] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:48.566236 25109 leader_election.cc:290] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.559124 25106 leader_election.cc:290] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:48.567045 25106 raft_consensus.cc:2798] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:48.568105 25106 raft_consensus.cc:491] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:48.568840 25106 raft_consensus.cc:3054] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.583756 25100 tablet_bootstrap.cc:492] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.584493 25100 ts_tablet_manager.cc:1397] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.082s user 0.020s sys 0.000s
I20250109 21:11:48.584245 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
W20250109 21:11:48.586201 24946 leader_election.cc:343] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.587435 25106 raft_consensus.cc:513] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.588096 25104 raft_consensus.cc:491] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:11:48.594725 25020 leader_election.cc:343] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.595230 25104 raft_consensus.cc:513] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.596457 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c33c211712430888fa872f1226d799" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.597224 25104 leader_election.cc:290] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.592690 25099 tablet_bootstrap.cc:492] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.593535 25101 tablet_bootstrap.cc:492] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.597980 25099 ts_tablet_manager.cc:1397] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.051s user 0.010s sys 0.008s
W20250109 21:11:48.597895 24873 leader_election.cc:343] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.598251 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.598049 25101 ts_tablet_manager.cc:1397] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.092s user 0.031s sys 0.055s
I20250109 21:11:48.594528 25127 raft_consensus.cc:491] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
W20250109 21:11:48.600693 24873 leader_election.cc:343] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.601436 25100 raft_consensus.cc:357] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.601724 25099 raft_consensus.cc:357] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.602226 25100 raft_consensus.cc:383] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.602515 25099 raft_consensus.cc:383] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.602725 25100 raft_consensus.cc:738] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.602931 25099 raft_consensus.cc:738] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.603422 25101 raft_consensus.cc:357] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.604202 25101 raft_consensus.cc:383] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.603694 25100 consensus_queue.cc:260] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.603760 25099 consensus_queue.cc:260] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.604506 25101 raft_consensus.cc:738] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.605226 25101 consensus_queue.cc:260] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.606650 25100 ts_tablet_manager.cc:1428] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.018s user 0.008s sys 0.000s
I20250109 21:11:48.607489 25101 ts_tablet_manager.cc:1428] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:11:48.606549 25099 ts_tablet_manager.cc:1428] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.008s user 0.006s sys 0.000s
I20250109 21:11:48.607668 25100 tablet_bootstrap.cc:492] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.608042 25106 leader_election.cc:290] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:48.610687 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.611475 25058 raft_consensus.cc:2388] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4841879f5e4347918a29b974a7cadd49 in current term 1: Already voted for candidate 5623262d5bc949f7907acb0a7215d9b4 in this term.
I20250109 21:11:48.611569 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:48.608441 25101 tablet_bootstrap.cc:492] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.608821 25099 tablet_bootstrap.cc:492] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.609436 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:48.613152 25109 raft_consensus.cc:491] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.613416 24983 raft_consensus.cc:3054] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
W20250109 21:11:48.614503 25020 leader_election.cc:343] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.613698 25109 raft_consensus.cc:513] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.618050 25109 leader_election.cc:290] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.612627 24949 leader_election.cc:304] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49; no voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:48.618762 25101 tablet_bootstrap.cc:654] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.619163 25099 tablet_bootstrap.cc:654] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.620533 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.621140 25058 raft_consensus.cc:2463] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 0.
I20250109 21:11:48.622113 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:48.625633 24949 leader_election.cc:304] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:48.632505 25099 tablet_bootstrap.cc:492] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.633014 25099 ts_tablet_manager.cc:1397] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.024s user 0.011s sys 0.005s
I20250109 21:11:48.635756 25099 raft_consensus.cc:357] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.600216 25127 raft_consensus.cc:513] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.636523 25099 raft_consensus.cc:383] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.636835 25099 raft_consensus.cc:738] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.637059 24908 raft_consensus.cc:2463] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 0.
I20250109 21:11:48.637948 25099 consensus_queue.cc:260] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.640046 24983 raft_consensus.cc:2463] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:48.640568 25099 ts_tablet_manager.cc:1428] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.007s user 0.004s sys 0.004s
I20250109 21:11:48.640697 25109 raft_consensus.cc:2743] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:48.641522 25099 tablet_bootstrap.cc:492] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.643241 25109 raft_consensus.cc:2798] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:48.643797 25109 raft_consensus.cc:491] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:48.644212 25109 raft_consensus.cc:3054] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.645579 25104 raft_consensus.cc:491] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.646095 25104 raft_consensus.cc:513] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.648111 25104 leader_election.cc:290] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.648234 25099 tablet_bootstrap.cc:654] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.649755 24982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c33c211712430888fa872f1226d799" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:48.651265 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
W20250109 21:11:48.654346 24870 leader_election.cc:343] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.654990 24870 leader_election.cc:304] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0ecd709a624128b4513100dfc72fc6; no voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4
W20250109 21:11:48.656493 24870 leader_election.cc:343] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.656975 24870 leader_election.cc:304] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0ecd709a624128b4513100dfc72fc6; no voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4
I20250109 21:11:48.658159 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bf434726e740a1a55bb757ea6c7a04" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:48.659260 25099 tablet_bootstrap.cc:492] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.659735 25099 ts_tablet_manager.cc:1397] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.018s user 0.013s sys 0.004s
I20250109 21:11:48.660060 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bf434726e740a1a55bb757ea6c7a04" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.659771 25109 raft_consensus.cc:513] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.660743 25058 raft_consensus.cc:2463] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:48.662209 24873 leader_election.cc:304] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.662343 25104 raft_consensus.cc:2743] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:48.663326 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:48.663684 25104 raft_consensus.cc:2743] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:48.663987 24908 raft_consensus.cc:3054] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.662207 25099 raft_consensus.cc:357] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.663928 25133 raft_consensus.cc:2798] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:48.665334 25099 raft_consensus.cc:383] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.665488 25133 raft_consensus.cc:491] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:48.665789 25099 raft_consensus.cc:738] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.665927 25133 raft_consensus.cc:3054] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.666551 25099 consensus_queue.cc:260] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.669582 25099 ts_tablet_manager.cc:1428] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.010s user 0.006s sys 0.000s
I20250109 21:11:48.669196 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:48.670102 25106 raft_consensus.cc:491] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.670243 24981 raft_consensus.cc:2388] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0ecd709a624128b4513100dfc72fc6 in current term 1: Already voted for candidate 4841879f5e4347918a29b974a7cadd49 in this term.
I20250109 21:11:48.671223 25099 tablet_bootstrap.cc:492] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:48.670699 25106 raft_consensus.cc:513] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.672220 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.672861 25058 raft_consensus.cc:2463] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:48.673715 25106 leader_election.cc:290] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:48.674646 24873 leader_election.cc:304] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.676587 25133 raft_consensus.cc:513] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.677218 25099 tablet_bootstrap.cc:654] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.677719 25100 tablet_bootstrap.cc:654] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.679831 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bf434726e740a1a55bb757ea6c7a04" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:48.680568 25058 raft_consensus.cc:3054] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.676589 24908 raft_consensus.cc:2463] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 1.
I20250109 21:11:48.682698 24946 leader_election.cc:304] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.683290 25132 raft_consensus.cc:2758] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader pre-election decision vote started in defunct term 0: won
I20250109 21:11:48.678805 25133 leader_election.cc:290] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.692418 25109 leader_election.cc:290] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.693352 25100 tablet_bootstrap.cc:492] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.694010 25100 ts_tablet_manager.cc:1397] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.087s user 0.010s sys 0.002s
I20250109 21:11:48.697705 25100 raft_consensus.cc:357] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.700198 25109 raft_consensus.cc:2798] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:48.701220 25109 raft_consensus.cc:695] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
W20250109 21:11:48.702855 24853 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:11:48.702765 25109 consensus_queue.cc:237] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.703439 25127 leader_election.cc:290] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
W20250109 21:11:48.670377 24870 leader_election.cc:343] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.706570 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "36bf434726e740a1a55bb757ea6c7a04" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:48.709029 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61207388546489497ba5192615f7ddc" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:48.709794 24908 raft_consensus.cc:2463] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:48.698660 25100 raft_consensus.cc:383] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
W20250109 21:11:48.709757 24870 leader_election.cc:343] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.710603 25100 raft_consensus.cc:738] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.715234 25020 leader_election.cc:304] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.716243 25106 raft_consensus.cc:2798] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:48.718104 25058 raft_consensus.cc:2463] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:48.720108 25106 raft_consensus.cc:491] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250109 21:11:48.719404 24949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.RequestConsensusVote -> {remote=127.19.136.195:44027, user_credentials={real_user=slave}} blocked reactor thread for 93889.2us
I20250109 21:11:48.720641 25106 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.721277 25020 leader_election.cc:304] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters: ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:48.722223 25126 raft_consensus.cc:2798] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:48.722714 24873 leader_election.cc:304] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters: 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:48.723887 25127 raft_consensus.cc:2798] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:48.724128 25101 tablet_bootstrap.cc:492] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.724332 25127 raft_consensus.cc:695] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:48.724772 25101 ts_tablet_manager.cc:1397] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.117s user 0.038s sys 0.049s
I20250109 21:11:48.725360 25127 consensus_queue.cc:237] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.727717 25106 raft_consensus.cc:513] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.728404 25101 raft_consensus.cc:357] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.729215 25101 raft_consensus.cc:383] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.729597 25101 raft_consensus.cc:738] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.730582 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61207388546489497ba5192615f7ddc" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:48.730350 25101 consensus_queue.cc:260] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.730837 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61207388546489497ba5192615f7ddc" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:48.730631 25099 tablet_bootstrap.cc:492] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:48.731532 24981 raft_consensus.cc:2463] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:48.731252 24908 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.732369 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:48.732581 25099 ts_tablet_manager.cc:1397] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.062s user 0.030s sys 0.020s
I20250109 21:11:48.732970 25058 raft_consensus.cc:3054] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.734001 25106 leader_election.cc:290] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:48.738586 24908 raft_consensus.cc:2463] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:48.739531 25020 leader_election.cc:304] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.741304 25106 raft_consensus.cc:2798] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:48.715961 25100 consensus_queue.cc:260] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.742280 25106 raft_consensus.cc:695] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:48.743120 25106 consensus_queue.cc:237] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:48.744505 25100 ts_tablet_manager.cc:1428] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.050s user 0.006s sys 0.002s
I20250109 21:11:48.745036 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61207388546489497ba5192615f7ddc" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:48.745569 24981 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.748052 25099 raft_consensus.cc:357] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.745577 24804 catalog_manager.cc:5526] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:48.755682 25137 raft_consensus.cc:491] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.756309 25137 raft_consensus.cc:513] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.758612 25137 leader_election.cc:290] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:48.752247 24801 catalog_manager.cc:5526] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:48.759570 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:48.760635 24908 raft_consensus.cc:2463] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:48.761580 25020 leader_election.cc:304] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.761845 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:48.754045 24981 raft_consensus.cc:2463] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:48.755007 25126 raft_consensus.cc:695] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:48.762674 25106 raft_consensus.cc:2798] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:48.763072 25106 raft_consensus.cc:491] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
W20250109 21:11:48.763320 25020 leader_election.cc:343] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.763788 25126 consensus_queue.cc:237] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.758867 25099 raft_consensus.cc:383] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.767055 25099 raft_consensus.cc:738] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.767222 25101 ts_tablet_manager.cc:1428] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.042s user 0.023s sys 0.021s
I20250109 21:11:48.767732 25099 consensus_queue.cc:260] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.759567 25100 tablet_bootstrap.cc:492] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.768796 25101 tablet_bootstrap.cc:492] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.763420 25106 raft_consensus.cc:3054] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.775918 25100 tablet_bootstrap.cc:654] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.777467 25101 tablet_bootstrap.cc:654] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.777794 25106 raft_consensus.cc:513] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.752815 25058 raft_consensus.cc:2463] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 1.
I20250109 21:11:48.780536 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:48.781250 24908 raft_consensus.cc:3054] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.781616 25099 ts_tablet_manager.cc:1428] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.042s user 0.000s sys 0.006s
I20250109 21:11:48.782632 24805 catalog_manager.cc:5526] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:48.790040 24908 raft_consensus.cc:2463] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:48.791200 25020 leader_election.cc:304] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.792655 25126 raft_consensus.cc:2798] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:48.793792 25130 raft_consensus.cc:491] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.793898 25126 raft_consensus.cc:695] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:48.794653 25100 tablet_bootstrap.cc:492] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.794284 25130 raft_consensus.cc:513] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.795625 25100 ts_tablet_manager.cc:1397] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.036s user 0.011s sys 0.008s
I20250109 21:11:48.795087 25126 consensus_queue.cc:237] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.796681 25130 leader_election.cc:290] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.797911 25106 leader_election.cc:290] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:48.798622 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b36c529424042cca5930cbea746ee97" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.799486 25058 raft_consensus.cc:2463] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 0.
I20250109 21:11:48.799662 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:48.800879 24949 leader_election.cc:304] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:48.800781 25100 raft_consensus.cc:357] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.801606 25100 raft_consensus.cc:383] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.801915 25100 raft_consensus.cc:738] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
W20250109 21:11:48.802240 25020 leader_election.cc:343] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:48.802791 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b36c529424042cca5930cbea746ee97" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:48.803159 25130 raft_consensus.cc:2798] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:48.803555 25130 raft_consensus.cc:491] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:48.804072 25130 raft_consensus.cc:3054] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.804823 25100 consensus_queue.cc:260] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.803506 24908 raft_consensus.cc:2463] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 0.
I20250109 21:11:48.806571 25101 tablet_bootstrap.cc:492] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.807368 25101 ts_tablet_manager.cc:1397] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.039s user 0.018s sys 0.009s
I20250109 21:11:48.810209 25100 ts_tablet_manager.cc:1428] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.014s user 0.005s sys 0.001s
I20250109 21:11:48.811249 25100 tablet_bootstrap.cc:492] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.811586 25130 raft_consensus.cc:513] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.813848 25101 raft_consensus.cc:357] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.815937 25101 raft_consensus.cc:383] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.816118 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b36c529424042cca5930cbea746ee97" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:48.816385 25101 raft_consensus.cc:738] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.816831 25058 raft_consensus.cc:3054] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.817602 25101 consensus_queue.cc:260] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.818746 25100 tablet_bootstrap.cc:654] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.821015 25101 ts_tablet_manager.cc:1428] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.013s user 0.004s sys 0.002s
I20250109 21:11:48.823916 25101 tablet_bootstrap.cc:492] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:48.814246 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b36c529424042cca5930cbea746ee97" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:48.824515 24908 raft_consensus.cc:3054] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.832013 25101 tablet_bootstrap.cc:654] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.835657 24908 raft_consensus.cc:2463] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 1.
I20250109 21:11:48.836892 24946 leader_election.cc:304] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.824079 25058 raft_consensus.cc:2463] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 1.
I20250109 21:11:48.838160 25109 raft_consensus.cc:2798] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:48.815135 25130 leader_election.cc:290] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.852483 25109 raft_consensus.cc:695] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:48.853123 25109 consensus_queue.cc:237] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.857121 25100 tablet_bootstrap.cc:492] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.857672 25100 ts_tablet_manager.cc:1397] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.047s user 0.004s sys 0.007s
I20250109 21:11:48.860419 25100 raft_consensus.cc:357] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.861150 25100 raft_consensus.cc:383] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.862583 25100 raft_consensus.cc:738] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.863662 25100 consensus_queue.cc:260] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.864477 25101 tablet_bootstrap.cc:492] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:48.865096 25101 ts_tablet_manager.cc:1397] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.041s user 0.016s sys 0.016s
I20250109 21:11:48.867173 25100 ts_tablet_manager.cc:1428] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.009s user 0.007s sys 0.001s
I20250109 21:11:48.867650 25101 raft_consensus.cc:357] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.868141 25100 tablet_bootstrap.cc:492] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.868340 25101 raft_consensus.cc:383] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.868602 25101 raft_consensus.cc:738] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.869226 25101 consensus_queue.cc:260] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.869582 24804 catalog_manager.cc:5526] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:48.871335 25101 ts_tablet_manager.cc:1428] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.006s user 0.006s sys 0.001s
I20250109 21:11:48.872521 25109 raft_consensus.cc:491] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.873085 25109 raft_consensus.cc:513] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.875083 25109 leader_election.cc:290] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.876519 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c33c211712430888fa872f1226d799" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:48.876690 25100 tablet_bootstrap.cc:654] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.877075 24908 raft_consensus.cc:2463] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 0.
I20250109 21:11:48.878114 24946 leader_election.cc:304] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.878790 25109 raft_consensus.cc:2798] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:48.879204 25109 raft_consensus.cc:491] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:48.879607 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c33c211712430888fa872f1226d799" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.880618 25058 raft_consensus.cc:2463] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 0.
I20250109 21:11:48.882066 24805 catalog_manager.cc:5526] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:48.879587 25109 raft_consensus.cc:3054] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.883862 24805 catalog_manager.cc:5526] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:48.889093 25100 tablet_bootstrap.cc:492] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.889568 25100 ts_tablet_manager.cc:1397] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.022s user 0.001s sys 0.016s
I20250109 21:11:48.892019 25100 raft_consensus.cc:357] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.892653 25100 raft_consensus.cc:383] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.892944 25100 raft_consensus.cc:738] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.893468 25151 raft_consensus.cc:491] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.892998 25109 raft_consensus.cc:513] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.899518 25100 consensus_queue.cc:260] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.899521 25151 raft_consensus.cc:513] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.902057 25100 ts_tablet_manager.cc:1428] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.012s user 0.005s sys 0.008s
I20250109 21:11:48.902741 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:48.902962 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.903374 25151 leader_election.cc:290] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.903703 24907 raft_consensus.cc:2388] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4841879f5e4347918a29b974a7cadd49 in current term 1: Already voted for candidate 5623262d5bc949f7907acb0a7215d9b4 in this term.
I20250109 21:11:48.904183 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c33c211712430888fa872f1226d799" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:48.904779 24908 raft_consensus.cc:3054] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.904839 24946 leader_election.cc:304] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49; no voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:48.905966 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e2c33c211712430888fa872f1226d799" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:48.906203 25151 raft_consensus.cc:3054] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.906574 25058 raft_consensus.cc:3054] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.911998 24908 raft_consensus.cc:2463] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 1.
I20250109 21:11:48.903132 25100 tablet_bootstrap.cc:492] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:48.913175 24946 leader_election.cc:304] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.913390 25058 raft_consensus.cc:2463] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 1.
I20250109 21:11:48.914089 25130 raft_consensus.cc:2798] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:48.914547 25109 leader_election.cc:290] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.916639 25151 raft_consensus.cc:2743] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:48.917398 25130 raft_consensus.cc:695] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:48.918311 25130 consensus_queue.cc:237] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.919019 25100 tablet_bootstrap.cc:654] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:48.921334 25154 raft_consensus.cc:491] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:48.921928 25154 raft_consensus.cc:513] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.924798 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c28f7e01f64c90a201ea5904bb178f" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:48.925418 24908 raft_consensus.cc:2463] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 0.
I20250109 21:11:48.925971 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c28f7e01f64c90a201ea5904bb178f" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:48.926497 25058 raft_consensus.cc:2463] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 0.
I20250109 21:11:48.926642 24946 leader_election.cc:304] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:48.927570 25130 raft_consensus.cc:2798] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:48.927736 25100 tablet_bootstrap.cc:492] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:48.927659 25154 leader_election.cc:290] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.928032 25130 raft_consensus.cc:491] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:48.928390 25100 ts_tablet_manager.cc:1397] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.025s user 0.012s sys 0.003s
I20250109 21:11:48.928546 25130 raft_consensus.cc:3054] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.929518 24801 catalog_manager.cc:5526] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:48.931007 25100 raft_consensus.cc:357] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.931865 25100 raft_consensus.cc:383] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:48.932168 25100 raft_consensus.cc:738] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:48.932858 25100 consensus_queue.cc:260] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.935490 25100 ts_tablet_manager.cc:1428] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.007s user 0.006s sys 0.000s
I20250109 21:11:48.935438 25130 raft_consensus.cc:513] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.937294 25130 leader_election.cc:290] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:48.938050 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c28f7e01f64c90a201ea5904bb178f" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:48.938517 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c28f7e01f64c90a201ea5904bb178f" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:48.938642 24908 raft_consensus.cc:3054] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.939157 25058 raft_consensus.cc:3054] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:48.944334 25058 raft_consensus.cc:2463] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 1.
I20250109 21:11:48.945099 24949 leader_election.cc:304] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:48.945520 24908 raft_consensus.cc:2463] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 1.
I20250109 21:11:48.945669 25130 raft_consensus.cc:2798] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:48.946123 25130 raft_consensus.cc:695] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:48.946887 25130 consensus_queue.cc:237] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:48.952701 24801 catalog_manager.cc:5526] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 0 to 1, leader changed from <none> to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 1 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:49.030045 25127 raft_consensus.cc:491] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:49.030556 25127 raft_consensus.cc:513] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.032189 25127 leader_election.cc:290] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:49.032920 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:49.033104 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:49.033622 24981 raft_consensus.cc:2388] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate ef0ecd709a624128b4513100dfc72fc6 in current term 1: Already voted for candidate 5623262d5bc949f7907acb0a7215d9b4 in this term.
I20250109 21:11:49.034444 24870 leader_election.cc:304] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: ef0ecd709a624128b4513100dfc72fc6; no voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4
I20250109 21:11:49.035040 25127 raft_consensus.cc:3054] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:49.040205 25127 raft_consensus.cc:2743] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:49.081777 25126 raft_consensus.cc:491] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:49.082340 25126 raft_consensus.cc:513] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.083890 25126 leader_election.cc:290] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:49.084698 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:49.084923 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:49.085414 24908 raft_consensus.cc:2463] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:49.085515 24981 raft_consensus.cc:2463] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:49.086412 25020 leader_election.cc:304] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:49.087000 25126 raft_consensus.cc:2798] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:49.087281 25126 raft_consensus.cc:491] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:49.087596 25126 raft_consensus.cc:3054] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:49.093559 25126 raft_consensus.cc:513] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.094995 25126 leader_election.cc:290] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:49.095616 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:49.095891 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:49.096113 24908 raft_consensus.cc:3054] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:49.096402 24981 raft_consensus.cc:3054] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:49.100502 24908 raft_consensus.cc:2463] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:49.100739 24981 raft_consensus.cc:2463] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:49.101519 25020 leader_election.cc:304] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:49.102079 25126 raft_consensus.cc:2798] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:49.102478 25126 raft_consensus.cc:695] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:49.103163 25126 consensus_queue.cc:237] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.109844 24801 catalog_manager.cc:5526] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:49.133627 25126 consensus_queue.cc:1035] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.143028 25126 consensus_queue.cc:1035] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.144771 24981 raft_consensus.cc:3054] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:49.151902 25130 consensus_queue.cc:1035] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.155822 25133 consensus_queue.cc:1035] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.164417 25154 consensus_queue.cc:1035] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.178195 25133 consensus_queue.cc:1035] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.194197 25126 consensus_queue.cc:1035] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.202690 25126 consensus_queue.cc:1035] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.221830 25139 consensus_queue.cc:1035] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.230621 25139 consensus_queue.cc:1035] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.255981 25058 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c61207388546489497ba5192615f7ddc"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
mode: GRACEFUL
new_leader_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:33054
I20250109 21:11:49.256512 25058 raft_consensus.cc:604] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Received request to transfer leadership to TS ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:49.260411 25058 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
mode: GRACEFUL
new_leader_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:33054
I20250109 21:11:49.260828 25058 raft_consensus.cc:604] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Received request to transfer leadership to TS ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:49.271570 24981 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
mode: GRACEFUL
new_leader_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:44944
I20250109 21:11:49.272006 24981 raft_consensus.cc:604] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Received request to transfer leadership to TS ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:49.277865 25058 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
mode: GRACEFUL
new_leader_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:33054
I20250109 21:11:49.278285 25058 raft_consensus.cc:604] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Received request to transfer leadership to TS 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:49.284679 25057 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
mode: GRACEFUL
new_leader_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:33054
I20250109 21:11:49.284740 25154 consensus_queue.cc:1035] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.285321 25057 raft_consensus.cc:604] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Received request to transfer leadership to TS 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:49.285465 25130 consensus_queue.cc:1035] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.293242 24981 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e7c28f7e01f64c90a201ea5904bb178f"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
mode: GRACEFUL
new_leader_uuid: "5623262d5bc949f7907acb0a7215d9b4"
from {username='slave'} at 127.0.0.1:44944
I20250109 21:11:49.293824 24981 raft_consensus.cc:604] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Received request to transfer leadership to TS 5623262d5bc949f7907acb0a7215d9b4
I20250109 21:11:49.341692 25130 consensus_queue.cc:1035] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.351080 25130 consensus_queue.cc:1035] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.510885 25130 consensus_queue.cc:1035] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.521173 25178 consensus_queue.cc:1035] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.528353 25130 raft_consensus.cc:988] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49: : Instructing follower 5623262d5bc949f7907acb0a7215d9b4 to start an election
I20250109 21:11:49.528788 25178 raft_consensus.cc:1076] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Signalling peer 5623262d5bc949f7907acb0a7215d9b4 to start an election
I20250109 21:11:49.530158 25057 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e7c28f7e01f64c90a201ea5904bb178f"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
from {username='slave'} at 127.0.0.1:33046
I20250109 21:11:49.530615 25057 raft_consensus.cc:491] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:49.530879 25057 raft_consensus.cc:3054] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.536111 25057 raft_consensus.cc:513] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.537870 25057 leader_election.cc:290] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:49.538537 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c28f7e01f64c90a201ea5904bb178f" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:49.538831 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e7c28f7e01f64c90a201ea5904bb178f" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:49.539269 24908 raft_consensus.cc:3054] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.539475 24981 raft_consensus.cc:3049] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:49.539858 24981 raft_consensus.cc:738] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:49.540623 24981 consensus_queue.cc:260] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.541918 24981 raft_consensus.cc:3054] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.546772 24908 raft_consensus.cc:2463] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 2.
I20250109 21:11:49.547968 25020 leader_election.cc:304] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:49.548455 24981 raft_consensus.cc:2463] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 2.
I20250109 21:11:49.548774 25137 raft_consensus.cc:2798] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:49.549268 25137 raft_consensus.cc:695] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 2 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:49.549949 25137 consensus_queue.cc:237] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.555243 24804 catalog_manager.cc:5526] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 1 to 2, leader changed from 4841879f5e4347918a29b974a7cadd49 (127.19.136.194) to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:49.585028 25137 consensus_queue.cc:1035] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.590759 25126 raft_consensus.cc:988] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4: : Instructing follower ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:49.591171 25139 raft_consensus.cc:1076] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Signalling peer ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:49.593075 24907 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:40448
I20250109 21:11:49.593819 24907 raft_consensus.cc:491] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:49.594178 24907 raft_consensus.cc:3054] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.596262 25139 consensus_queue.cc:1035] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:49.601598 24907 raft_consensus.cc:513] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.606803 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:49.607115 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "b0708b4b9a5c43959b1b3d303115fad9" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:49.607384 24981 raft_consensus.cc:3054] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.607759 25057 raft_consensus.cc:3049] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:49.608186 25057 raft_consensus.cc:738] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:49.608290 24907 leader_election.cc:290] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:49.608965 25057 consensus_queue.cc:260] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.609867 25057 raft_consensus.cc:3054] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.613924 24981 raft_consensus.cc:2463] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:49.614749 25057 raft_consensus.cc:2463] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:49.614954 24870 leader_election.cc:304] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:49.615725 25133 raft_consensus.cc:2798] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:49.616210 25133 raft_consensus.cc:695] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:49.616920 25133 consensus_queue.cc:237] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.621800 24805 catalog_manager.cc:5526] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 1 to 2, leader changed from 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195) to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:49.697822 25137 raft_consensus.cc:988] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4: : Instructing follower 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:49.698189 25139 raft_consensus.cc:1076] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Signalling peer 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:49.699551 24981 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:44930
I20250109 21:11:49.700018 24981 raft_consensus.cc:491] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:49.700320 24981 raft_consensus.cc:3054] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.706211 24981 raft_consensus.cc:513] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.708182 24981 leader_election.cc:290] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:49.708842 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:49.709470 24907 raft_consensus.cc:3054] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.709452 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8e2535f2645d4849b03aeeb84682f73e" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:49.710150 25057 raft_consensus.cc:3049] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:49.710470 25057 raft_consensus.cc:738] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:49.711252 25057 consensus_queue.cc:260] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.712538 25057 raft_consensus.cc:3054] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.715000 24907 raft_consensus.cc:2463] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:49.716080 24946 leader_election.cc:304] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:49.716881 25178 raft_consensus.cc:2798] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:49.717348 25178 raft_consensus.cc:695] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:49.718132 25178 consensus_queue.cc:237] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.719362 25057 raft_consensus.cc:2463] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:49.723531 25126 raft_consensus.cc:988] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4: : Instructing follower ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:49.723975 25137 raft_consensus.cc:1076] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Signalling peer ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:49.726442 24908 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c61207388546489497ba5192615f7ddc"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:40448
I20250109 21:11:49.726975 24908 raft_consensus.cc:491] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:49.726763 24804 catalog_manager.cc:5526] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 1 to 2, leader changed from 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195) to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:49.727370 24908 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.731314 25109 raft_consensus.cc:988] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49: : Instructing follower ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:49.731719 25178 raft_consensus.cc:1076] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Signalling peer ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:49.733197 24907 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:40464
I20250109 21:11:49.733058 24908 raft_consensus.cc:513] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:49.733775 24907 raft_consensus.cc:491] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:49.734133 24907 raft_consensus.cc:3054] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.735211 24908 leader_election.cc:290] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Requested vote from peers 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:49.737735 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61207388546489497ba5192615f7ddc" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:49.738212 24981 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.739527 24907 raft_consensus.cc:513] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.741755 24907 leader_election.cc:290] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:49.742002 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:49.742606 24983 raft_consensus.cc:3049] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:49.742951 24983 raft_consensus.cc:738] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:49.743486 24981 raft_consensus.cc:2463] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:49.743769 24983 consensus_queue.cc:260] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.744443 24870 leader_election.cc:304] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:49.745100 24983 raft_consensus.cc:3054] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.745164 25133 raft_consensus.cc:2798] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:49.745114 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61207388546489497ba5192615f7ddc" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:49.745695 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4df8bcc17f3d4430b1eebf02c2e60c52" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:49.745898 25133 raft_consensus.cc:695] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:49.745923 25057 raft_consensus.cc:3049] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:49.746483 25057 raft_consensus.cc:738] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:49.747018 25058 raft_consensus.cc:3054] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.746903 25133 consensus_queue.cc:237] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:49.747242 25057 consensus_queue.cc:260] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:49.748530 25057 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.751662 24983 raft_consensus.cc:2463] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:49.752841 24870 leader_election.cc:304] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:49.754128 24804 catalog_manager.cc:5526] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 1 to 2, leader changed from 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195) to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:49.755097 25133 raft_consensus.cc:2798] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:49.755291 25058 raft_consensus.cc:2463] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:49.755507 25057 raft_consensus.cc:2463] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:49.757031 25133 raft_consensus.cc:695] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:49.757983 25133 consensus_queue.cc:237] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.762786 25126 raft_consensus.cc:988] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4: : Instructing follower 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:49.763185 25139 raft_consensus.cc:1076] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Signalling peer 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:49.764585 24983 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:44930
I20250109 21:11:49.765003 24983 raft_consensus.cc:491] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:49.765338 24983 raft_consensus.cc:3054] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.766516 24804 catalog_manager.cc:5526] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 1 to 2, leader changed from 4841879f5e4347918a29b974a7cadd49 (127.19.136.194) to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:49.770437 24983 raft_consensus.cc:513] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.772872 24983 leader_election.cc:290] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:49.773187 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:49.773793 24907 raft_consensus.cc:3054] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.775395 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "8fe14f975aa84664bb0ed6080d7c89e4" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:49.776062 25057 raft_consensus.cc:3049] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:49.776376 25057 raft_consensus.cc:738] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:49.777089 25057 consensus_queue.cc:260] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.777981 25057 raft_consensus.cc:3054] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:49.779353 24907 raft_consensus.cc:2463] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:49.780267 24946 leader_election.cc:304] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:49.780902 25178 raft_consensus.cc:2798] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:49.781376 25178 raft_consensus.cc:695] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:49.782172 25178 consensus_queue.cc:237] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:49.783833 25057 raft_consensus.cc:2463] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:49.788214 24804 catalog_manager.cc:5526] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 1 to 2, leader changed from 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195) to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:50.032920 24983 raft_consensus.cc:1270] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.034102 25133 consensus_queue.cc:1035] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.041210 25057 raft_consensus.cc:1270] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.043183 25132 consensus_queue.cc:1035] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.074347 24983 raft_consensus.cc:1270] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Refusing update from remote peer 5623262d5bc949f7907acb0a7215d9b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.075462 25139 consensus_queue.cc:1035] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.082257 24907 raft_consensus.cc:1270] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 5623262d5bc949f7907acb0a7215d9b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.083850 25106 consensus_queue.cc:1035] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.101814 25057 raft_consensus.cc:1270] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.102880 25178 consensus_queue.cc:1035] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.109493 24907 raft_consensus.cc:1270] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.111677 25178 consensus_queue.cc:1035] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.157382 25057 raft_consensus.cc:1270] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.158545 25132 consensus_queue.cc:1035] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.166811 24983 raft_consensus.cc:1270] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.168942 25185 consensus_queue.cc:1035] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.244863 24907 raft_consensus.cc:1270] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.245930 25130 consensus_queue.cc:1035] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.253130 25057 raft_consensus.cc:1270] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.254568 25178 consensus_queue.cc:1035] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.291162 24983 raft_consensus.cc:1270] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.292271 25185 consensus_queue.cc:1035] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:50.302814 25057 raft_consensus.cc:1270] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:50.304306 25132 consensus_queue.cc:1035] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:52.295234 20003 test_util.cc:274] Using random seed: 1834522408
I20250109 21:11:52.316660 24805 catalog_manager.cc:1909] Servicing CreateTable request from {username='slave'} at 127.0.0.1:54326:
name: "soft_deleted_table"
schema {
columns {
name: "key"
type: INT32
is_key: true
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "int_val"
type: INT32
is_key: false
is_nullable: false
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
columns {
name: "string_val"
type: STRING
is_key: false
is_nullable: true
encoding: AUTO_ENCODING
compression: DEFAULT_COMPRESSION
cfile_block_size: 0
immutable: false
}
}
num_replicas: 3
split_rows_range_bounds {
rows: "\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q""\004\001\000\216\3438\016\004\001\000\034\307q\034\004\001\000\252\252\252*\004\001\0008\216\3438\004\001\000\306q\034G\004\001\000TUUU\004\001\000\3428\216c\004\001\000p\034\307q"
indirect_data: """"
}
partition_schema {
range_schema {
columns {
name: "key"
}
}
}
W20250109 21:11:52.318485 24805 catalog_manager.cc:6885] The number of live tablet servers is not enough to re-replicate a tablet replica of the newly created table soft_deleted_table in case of a server failure: 4 tablet servers would be needed, 3 are available. Consider bringing up more tablet servers.
I20250109 21:11:52.363085 24890 tablet_service.cc:1467] Processing CreateTablet for tablet 3db5be22d5e44289a4f05e0472013e31 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:52.363703 24970 tablet_service.cc:1467] Processing CreateTablet for tablet 3db5be22d5e44289a4f05e0472013e31 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:52.364966 24970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5be22d5e44289a4f05e0472013e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.364176 24890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5be22d5e44289a4f05e0472013e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.365725 25039 tablet_service.cc:1467] Processing CreateTablet for tablet 3db5be22d5e44289a4f05e0472013e31 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION VALUES < 238609294
I20250109 21:11:52.366204 24891 tablet_service.cc:1467] Processing CreateTablet for tablet 6008039b2a714bada9232df36acf69ea (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:52.366868 25039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 3db5be22d5e44289a4f05e0472013e31. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.367383 24891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6008039b2a714bada9232df36acf69ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.370800 24972 tablet_service.cc:1467] Processing CreateTablet for tablet 6008039b2a714bada9232df36acf69ea (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:52.372239 24972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6008039b2a714bada9232df36acf69ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.396391 25047 tablet_service.cc:1467] Processing CreateTablet for tablet 6008039b2a714bada9232df36acf69ea (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 238609294 <= VALUES < 477218588
I20250109 21:11:52.397769 25047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 6008039b2a714bada9232df36acf69ea. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.398257 24895 tablet_service.cc:1467] Processing CreateTablet for tablet 5448fa51a40c48bdb4fc1bba783f069a (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:52.398849 24969 tablet_service.cc:1467] Processing CreateTablet for tablet 5448fa51a40c48bdb4fc1bba783f069a (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:52.399947 24895 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5448fa51a40c48bdb4fc1bba783f069a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.400126 24969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5448fa51a40c48bdb4fc1bba783f069a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.403393 25206 tablet_bootstrap.cc:492] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.409890 25206 tablet_bootstrap.cc:654] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.416050 25039 tablet_service.cc:1467] Processing CreateTablet for tablet 5448fa51a40c48bdb4fc1bba783f069a (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 477218588 <= VALUES < 715827882
I20250109 21:11:52.417340 25039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5448fa51a40c48bdb4fc1bba783f069a. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.436658 25207 tablet_bootstrap.cc:492] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.442616 24969 tablet_service.cc:1467] Processing CreateTablet for tablet ca9f7d9e7c60492dafa2eaf31ca18c7e (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:52.443974 24969 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9f7d9e7c60492dafa2eaf31ca18c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.444470 25047 tablet_service.cc:1467] Processing CreateTablet for tablet ca9f7d9e7c60492dafa2eaf31ca18c7e (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:52.445683 25047 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9f7d9e7c60492dafa2eaf31ca18c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.446501 24896 tablet_service.cc:1467] Processing CreateTablet for tablet e210d085e81c4b1ab4e3f74ecac93cf8 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:52.447705 24968 tablet_service.cc:1467] Processing CreateTablet for tablet e210d085e81c4b1ab4e3f74ecac93cf8 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:52.448223 24896 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e210d085e81c4b1ab4e3f74ecac93cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.448782 25040 tablet_service.cc:1467] Processing CreateTablet for tablet e210d085e81c4b1ab4e3f74ecac93cf8 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 954437176 <= VALUES < 1193046470
I20250109 21:11:52.449932 25207 tablet_bootstrap.cc:654] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.458491 25040 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e210d085e81c4b1ab4e3f74ecac93cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.461431 24898 tablet_service.cc:1467] Processing CreateTablet for tablet f741922802204b7f9899054395f6bedf (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:52.462656 24898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f741922802204b7f9899054395f6bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.463510 25205 tablet_bootstrap.cc:492] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.463376 25042 tablet_service.cc:1467] Processing CreateTablet for tablet f741922802204b7f9899054395f6bedf (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:52.464689 24966 tablet_service.cc:1467] Processing CreateTablet for tablet f741922802204b7f9899054395f6bedf (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1193046470 <= VALUES < 1431655764
I20250109 21:11:52.465255 25042 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f741922802204b7f9899054395f6bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.467245 24968 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet e210d085e81c4b1ab4e3f74ecac93cf8. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.467448 25044 tablet_service.cc:1467] Processing CreateTablet for tablet 4e06275a29b34e0b9773456bfb5b5954 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:52.468039 24966 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet f741922802204b7f9899054395f6bedf. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.468664 25044 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e06275a29b34e0b9773456bfb5b5954. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.469089 24892 tablet_service.cc:1467] Processing CreateTablet for tablet 4e06275a29b34e0b9773456bfb5b5954 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:52.479221 24892 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e06275a29b34e0b9773456bfb5b5954. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.485000 25207 tablet_bootstrap.cc:492] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.485494 24971 tablet_service.cc:1467] Processing CreateTablet for tablet 18e6733e937d466eb44925ad1601ba10 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:52.486770 24971 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e6733e937d466eb44925ad1601ba10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.483223 24890 tablet_service.cc:1467] Processing CreateTablet for tablet ca9f7d9e7c60492dafa2eaf31ca18c7e (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 715827882 <= VALUES < 954437176
I20250109 21:11:52.481097 24891 tablet_service.cc:1467] Processing CreateTablet for tablet 18e6733e937d466eb44925ad1601ba10 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:52.485533 25207 ts_tablet_manager.cc:1397] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.004s
I20250109 21:11:52.495572 24891 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e6733e937d466eb44925ad1601ba10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.494988 25039 tablet_service.cc:1467] Processing CreateTablet for tablet 18e6733e937d466eb44925ad1601ba10 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1670265058 <= VALUES < 1908874352
I20250109 21:11:52.497520 25039 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 18e6733e937d466eb44925ad1601ba10. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.497951 24898 tablet_service.cc:1467] Processing CreateTablet for tablet 5c7d315d074c4f8fa425b5e9a96e1f70 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:52.499116 24898 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7d315d074c4f8fa425b5e9a96e1f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.500365 24890 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet ca9f7d9e7c60492dafa2eaf31ca18c7e. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.502842 25043 tablet_service.cc:1467] Processing CreateTablet for tablet 5c7d315d074c4f8fa425b5e9a96e1f70 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:52.504052 25043 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7d315d074c4f8fa425b5e9a96e1f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.507349 24970 tablet_service.cc:1467] Processing CreateTablet for tablet 4e06275a29b34e0b9773456bfb5b5954 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1431655764 <= VALUES < 1670265058
I20250109 21:11:52.508570 24970 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 4e06275a29b34e0b9773456bfb5b5954. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.509100 25205 tablet_bootstrap.cc:654] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.508957 25207 raft_consensus.cc:357] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.509776 25207 raft_consensus.cc:383] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.510066 25207 raft_consensus.cc:738] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.510785 25207 consensus_queue.cc:260] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.515988 25207 ts_tablet_manager.cc:1428] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.021s user 0.006s sys 0.000s
I20250109 21:11:52.516918 25207 tablet_bootstrap.cc:492] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.519322 25206 tablet_bootstrap.cc:492] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.519836 25206 ts_tablet_manager.cc:1397] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.117s user 0.008s sys 0.022s
I20250109 21:11:52.530894 25207 tablet_bootstrap.cc:654] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.535881 24972 tablet_service.cc:1467] Processing CreateTablet for tablet 5c7d315d074c4f8fa425b5e9a96e1f70 (DEFAULT_TABLE table=soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8]), partition=RANGE (key) PARTITION 1908874352 <= VALUES
I20250109 21:11:52.537196 24972 data_dirs.cc:400] Could only allocate 1 dirs of requested 3 for tablet 5c7d315d074c4f8fa425b5e9a96e1f70. 1 dirs total, 0 dirs full, 0 dirs failed
I20250109 21:11:52.522634 25206 raft_consensus.cc:357] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.542217 25206 raft_consensus.cc:383] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.542618 25206 raft_consensus.cc:738] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.543506 25206 consensus_queue.cc:260] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.546088 25206 ts_tablet_manager.cc:1428] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.026s user 0.005s sys 0.002s
I20250109 21:11:52.552484 25206 tablet_bootstrap.cc:492] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.562093 25206 tablet_bootstrap.cc:654] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.568711 25207 tablet_bootstrap.cc:492] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.569271 25207 ts_tablet_manager.cc:1397] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.053s user 0.007s sys 0.007s
I20250109 21:11:52.571139 25205 tablet_bootstrap.cc:492] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:52.571758 25205 ts_tablet_manager.cc:1397] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.108s user 0.009s sys 0.003s
I20250109 21:11:52.571709 25207 raft_consensus.cc:357] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.572710 25207 raft_consensus.cc:383] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.573047 25207 raft_consensus.cc:738] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.573356 25206 tablet_bootstrap.cc:492] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.573889 25206 ts_tablet_manager.cc:1397] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.027s user 0.011s sys 0.000s
I20250109 21:11:52.574070 25207 consensus_queue.cc:260] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.575057 25193 raft_consensus.cc:491] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:52.575126 25205 raft_consensus.cc:357] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.575830 25205 raft_consensus.cc:383] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.575595 25193 raft_consensus.cc:513] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.576089 25205 raft_consensus.cc:738] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.577013 25206 raft_consensus.cc:357] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.577984 25206 raft_consensus.cc:383] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.577014 25205 consensus_queue.cc:260] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.578348 25206 raft_consensus.cc:738] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.579313 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6008039b2a714bada9232df36acf69ea" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:52.579200 25206 consensus_queue.cc:260] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
W20250109 21:11:52.581386 24870 leader_election.cc:343] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:52.581756 25206 ts_tablet_manager.cc:1428] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.008s user 0.003s sys 0.002s
I20250109 21:11:52.583177 25206 tablet_bootstrap.cc:492] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.583499 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6008039b2a714bada9232df36acf69ea" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:52.584059 25207 ts_tablet_manager.cc:1428] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.014s user 0.008s sys 0.004s
I20250109 21:11:52.584128 25058 raft_consensus.cc:2463] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:52.585064 25207 tablet_bootstrap.cc:492] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.585484 24873 leader_election.cc:304] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters: 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:52.586673 25193 leader_election.cc:290] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:52.587464 25193 raft_consensus.cc:2798] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:52.587826 25193 raft_consensus.cc:491] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:52.588132 25193 raft_consensus.cc:3054] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.589203 25206 tablet_bootstrap.cc:654] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.591069 25207 tablet_bootstrap.cc:654] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.598050 25205 ts_tablet_manager.cc:1428] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.026s user 0.006s sys 0.001s
I20250109 21:11:52.603717 25205 tablet_bootstrap.cc:492] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.615190 25207 tablet_bootstrap.cc:492] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.618539 25205 tablet_bootstrap.cc:654] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.618747 25207 ts_tablet_manager.cc:1397] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.034s user 0.016s sys 0.013s
I20250109 21:11:52.610886 25193 raft_consensus.cc:513] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.621486 25206 tablet_bootstrap.cc:492] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.622129 25206 ts_tablet_manager.cc:1397] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.039s user 0.009s sys 0.014s
I20250109 21:11:52.622800 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6008039b2a714bada9232df36acf69ea" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
W20250109 21:11:52.624248 24870 leader_election.cc:343] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:52.625268 25206 raft_consensus.cc:357] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.626019 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6008039b2a714bada9232df36acf69ea" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:52.626194 25193 leader_election.cc:290] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:52.626664 25058 raft_consensus.cc:3054] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.626031 25206 raft_consensus.cc:383] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.627439 25206 raft_consensus.cc:738] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.628381 25205 tablet_bootstrap.cc:492] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:52.628209 25206 consensus_queue.cc:260] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.628984 25205 ts_tablet_manager.cc:1397] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.025s user 0.015s sys 0.005s
I20250109 21:11:52.626142 25207 raft_consensus.cc:357] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.630865 25207 raft_consensus.cc:383] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.631052 25206 ts_tablet_manager.cc:1428] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.009s user 0.002s sys 0.006s
I20250109 21:11:52.631239 25207 raft_consensus.cc:738] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.632230 25206 tablet_bootstrap.cc:492] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.632064 25207 consensus_queue.cc:260] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.633929 25058 raft_consensus.cc:2463] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:52.634568 25207 ts_tablet_manager.cc:1428] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.015s user 0.005s sys 0.000s
I20250109 21:11:52.635085 24873 leader_election.cc:304] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters: 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:52.635499 25207 tablet_bootstrap.cc:492] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.636307 25214 raft_consensus.cc:2798] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:52.636790 25214 raft_consensus.cc:695] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:52.637550 25214 consensus_queue.cc:237] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.639701 25206 tablet_bootstrap.cc:654] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.641253 25207 tablet_bootstrap.cc:654] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.649585 25205 raft_consensus.cc:357] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.650664 25205 raft_consensus.cc:383] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.651101 25206 tablet_bootstrap.cc:492] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.651093 25205 raft_consensus.cc:738] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.651767 25206 ts_tablet_manager.cc:1397] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.020s user 0.017s sys 0.001s
I20250109 21:11:52.652176 25205 consensus_queue.cc:260] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.654573 25206 raft_consensus.cc:357] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.655349 25206 raft_consensus.cc:383] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.655695 25206 raft_consensus.cc:738] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.656431 25206 consensus_queue.cc:260] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.659472 25206 ts_tablet_manager.cc:1428] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250109 21:11:52.661440 25205 ts_tablet_manager.cc:1428] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.032s user 0.004s sys 0.003s
I20250109 21:11:52.666481 25205 tablet_bootstrap.cc:492] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.675771 25205 tablet_bootstrap.cc:654] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.665305 25206 tablet_bootstrap.cc:492] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.679754 24804 catalog_manager.cc:5526] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:52.686460 25207 tablet_bootstrap.cc:492] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.686893 25206 tablet_bootstrap.cc:654] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.687040 25207 ts_tablet_manager.cc:1397] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.052s user 0.018s sys 0.030s
I20250109 21:11:52.687551 25205 tablet_bootstrap.cc:492] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:52.688146 25205 ts_tablet_manager.cc:1397] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.022s user 0.014s sys 0.003s
I20250109 21:11:52.690101 25207 raft_consensus.cc:357] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.690968 25207 raft_consensus.cc:383] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.691289 25207 raft_consensus.cc:738] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.691725 25205 raft_consensus.cc:357] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.691979 25207 consensus_queue.cc:260] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.692883 25205 raft_consensus.cc:383] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.693302 25205 raft_consensus.cc:738] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.694972 25207 ts_tablet_manager.cc:1428] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.007s user 0.005s sys 0.002s
I20250109 21:11:52.694253 25205 consensus_queue.cc:260] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.695981 25207 tablet_bootstrap.cc:492] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.702158 25205 ts_tablet_manager.cc:1428] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.014s user 0.007s sys 0.001s
I20250109 21:11:52.702857 25207 tablet_bootstrap.cc:654] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.703665 25205 tablet_bootstrap.cc:492] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.712538 25205 tablet_bootstrap.cc:654] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.713558 25206 tablet_bootstrap.cc:492] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.714085 25206 ts_tablet_manager.cc:1397] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.049s user 0.010s sys 0.022s
I20250109 21:11:52.716552 25207 tablet_bootstrap.cc:492] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.717093 25207 ts_tablet_manager.cc:1397] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.021s user 0.003s sys 0.014s
I20250109 21:11:52.717036 25206 raft_consensus.cc:357] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.717990 25206 raft_consensus.cc:383] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.718426 25206 raft_consensus.cc:738] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.719415 25206 consensus_queue.cc:260] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.719940 25207 raft_consensus.cc:357] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.720765 25207 raft_consensus.cc:383] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.721084 25207 raft_consensus.cc:738] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.721764 25194 raft_consensus.cc:491] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:52.721737 25207 consensus_queue.cc:260] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.722463 25194 raft_consensus.cc:513] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.724305 25207 ts_tablet_manager.cc:1428] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.007s user 0.002s sys 0.004s
I20250109 21:11:52.724750 25194 leader_election.cc:290] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:52.725641 25205 tablet_bootstrap.cc:492] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:52.726009 25207 tablet_bootstrap.cc:492] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.726126 25205 ts_tablet_manager.cc:1397] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.023s user 0.002s sys 0.014s
I20250109 21:11:52.727385 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db5be22d5e44289a4f05e0472013e31" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:52.728053 24907 raft_consensus.cc:2463] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:52.729274 25020 leader_election.cc:304] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:52.730134 25194 raft_consensus.cc:2798] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:52.730515 25194 raft_consensus.cc:491] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:52.727406 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db5be22d5e44289a4f05e0472013e31" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:52.730960 25194 raft_consensus.cc:3054] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.731141 25206 ts_tablet_manager.cc:1428] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.017s user 0.010s sys 0.000s
I20250109 21:11:52.731348 24983 raft_consensus.cc:2463] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:52.732121 25206 tablet_bootstrap.cc:492] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.732373 25207 tablet_bootstrap.cc:654] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.738329 25206 tablet_bootstrap.cc:654] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
W20250109 21:11:52.745548 24853 auto_rebalancer.cc:227] Could not retrieve cluster info: Service unavailable: Tablet not running
I20250109 21:11:52.745867 25194 raft_consensus.cc:513] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.747828 25205 raft_consensus.cc:357] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.748615 25205 raft_consensus.cc:383] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.748917 25205 raft_consensus.cc:738] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.749706 25206 tablet_bootstrap.cc:492] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.750226 25206 ts_tablet_manager.cc:1397] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.018s user 0.009s sys 0.008s
I20250109 21:11:52.750720 25205 consensus_queue.cc:260] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.753134 25205 ts_tablet_manager.cc:1428] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.027s user 0.005s sys 0.000s
I20250109 21:11:52.753046 25206 raft_consensus.cc:357] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.754060 25206 raft_consensus.cc:383] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.754393 25206 raft_consensus.cc:738] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.754751 25194 leader_election.cc:290] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:52.755234 25206 consensus_queue.cc:260] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.756000 25205 tablet_bootstrap.cc:492] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.756528 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db5be22d5e44289a4f05e0472013e31" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:52.757344 24907 raft_consensus.cc:3054] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.762463 25205 tablet_bootstrap.cc:654] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.762554 25206 ts_tablet_manager.cc:1428] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.012s user 0.005s sys 0.000s
I20250109 21:11:52.763731 25206 tablet_bootstrap.cc:492] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.765686 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db5be22d5e44289a4f05e0472013e31" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:52.766299 24983 raft_consensus.cc:3054] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.765709 25207 tablet_bootstrap.cc:492] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.768797 25207 ts_tablet_manager.cc:1397] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.043s user 0.020s sys 0.020s
I20250109 21:11:52.769539 24907 raft_consensus.cc:2463] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:52.770172 25206 tablet_bootstrap.cc:654] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.770689 25020 leader_election.cc:304] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:52.771422 25194 raft_consensus.cc:2798] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:52.771806 25207 raft_consensus.cc:357] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.772555 25207 raft_consensus.cc:383] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.772909 25207 raft_consensus.cc:738] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.773777 25207 consensus_queue.cc:260] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.778044 25207 ts_tablet_manager.cc:1428] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.009s user 0.007s sys 0.000s
I20250109 21:11:52.779318 25207 tablet_bootstrap.cc:492] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.780387 24983 raft_consensus.cc:2463] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:52.788393 25214 raft_consensus.cc:491] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:52.795215 25214 raft_consensus.cc:513] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.798187 25194 raft_consensus.cc:695] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:52.799105 25194 consensus_queue.cc:237] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.802031 25213 raft_consensus.cc:491] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:52.802520 25213 raft_consensus.cc:513] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.804788 25207 tablet_bootstrap.cc:654] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.805580 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:52.807029 25213 leader_election.cc:290] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
W20250109 21:11:52.807957 24870 leader_election.cc:343] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:52.809156 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:52.809787 25057 raft_consensus.cc:2463] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:52.812500 25205 tablet_bootstrap.cc:492] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:52.813382 25205 ts_tablet_manager.cc:1397] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.058s user 0.017s sys 0.017s
I20250109 21:11:52.816020 24804 catalog_manager.cc:5526] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:52.819151 25194 raft_consensus.cc:491] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:52.819706 25206 tablet_bootstrap.cc:492] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.819555 24873 leader_election.cc:304] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters: 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:52.820163 25214 leader_election.cc:290] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:52.820721 25214 raft_consensus.cc:2798] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:52.821038 25214 raft_consensus.cc:491] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:52.821373 25214 raft_consensus.cc:3054] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.822935 25205 raft_consensus.cc:357] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.824429 25205 raft_consensus.cc:383] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.824793 25205 raft_consensus.cc:738] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.825590 25205 consensus_queue.cc:260] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.826431 25206 ts_tablet_manager.cc:1397] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.063s user 0.012s sys 0.041s
I20250109 21:11:52.828256 25205 ts_tablet_manager.cc:1428] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.014s user 0.008s sys 0.001s
I20250109 21:11:52.823968 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f741922802204b7f9899054395f6bedf" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:52.819662 25194 raft_consensus.cc:513] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.830744 25057 raft_consensus.cc:2463] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:52.830744 25206 raft_consensus.cc:357] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.831652 25206 raft_consensus.cc:383] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.831939 25206 raft_consensus.cc:738] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.832057 25207 tablet_bootstrap.cc:492] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.832612 25207 ts_tablet_manager.cc:1397] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.054s user 0.016s sys 0.008s
I20250109 21:11:52.832706 25206 consensus_queue.cc:260] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.832082 25194 leader_election.cc:290] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:52.833616 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5448fa51a40c48bdb4fc1bba783f069a" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:52.834277 24907 raft_consensus.cc:2463] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:52.834906 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f741922802204b7f9899054395f6bedf" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:52.835211 25206 ts_tablet_manager.cc:1428] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.008s user 0.008s sys 0.000s
I20250109 21:11:52.835502 24983 raft_consensus.cc:2463] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:52.835357 25207 raft_consensus.cc:357] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.835225 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5448fa51a40c48bdb4fc1bba783f069a" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:52.836130 25207 raft_consensus.cc:383] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.836242 25206 tablet_bootstrap.cc:492] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.836376 24981 raft_consensus.cc:2463] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:52.836445 25207 raft_consensus.cc:738] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.830382 25205 tablet_bootstrap.cc:492] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.841656 25214 raft_consensus.cc:513] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.842705 25206 tablet_bootstrap.cc:654] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.843739 25214 leader_election.cc:290] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:52.843327 25207 consensus_queue.cc:260] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.845999 25207 ts_tablet_manager.cc:1428] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.013s user 0.000s sys 0.007s
I20250109 21:11:52.847105 24870 leader_election.cc:304] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:52.848109 25213 raft_consensus.cc:2798] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:52.848404 25213 raft_consensus.cc:491] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:52.848678 25213 raft_consensus.cc:3054] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.849246 25207 tablet_bootstrap.cc:492] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.853513 25206 tablet_bootstrap.cc:492] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.853338 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:52.854120 25020 leader_election.cc:304] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:52.854393 25206 ts_tablet_manager.cc:1397] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.018s user 0.011s sys 0.006s
W20250109 21:11:52.855257 24870 leader_election.cc:343] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Tablet error from VoteRequest() call to peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Illegal state: must be running to vote when last-logged opid is not known
I20250109 21:11:52.855289 25228 raft_consensus.cc:2798] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:52.855692 25207 tablet_bootstrap.cc:654] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.855903 25228 raft_consensus.cc:491] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:52.856243 25228 raft_consensus.cc:3054] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.860316 25213 raft_consensus.cc:513] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.854790 25205 tablet_bootstrap.cc:654] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.862875 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f741922802204b7f9899054395f6bedf" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:52.863523 24981 raft_consensus.cc:3054] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.866071 25206 raft_consensus.cc:357] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.866772 25206 raft_consensus.cc:383] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.867049 25206 raft_consensus.cc:738] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.867693 25206 consensus_queue.cc:260] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.868027 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:52.868906 25057 raft_consensus.cc:3054] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.869961 25206 ts_tablet_manager.cc:1428] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.015s user 0.002s sys 0.002s
I20250109 21:11:52.871052 25213 leader_election.cc:290] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:52.872103 25206 tablet_bootstrap.cc:492] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4: Bootstrap starting.
I20250109 21:11:52.872315 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f741922802204b7f9899054395f6bedf" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:52.873116 25058 raft_consensus.cc:3054] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.877890 25206 tablet_bootstrap.cc:654] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.894992 25058 raft_consensus.cc:2463] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:52.894344 25228 raft_consensus.cc:513] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.898089 24981 raft_consensus.cc:2463] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:52.895531 25205 tablet_bootstrap.cc:492] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:52.899312 24870 leader_election.cc:304] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:52.899809 25205 ts_tablet_manager.cc:1397] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.070s user 0.014s sys 0.000s
I20250109 21:11:52.900301 25213 raft_consensus.cc:2798] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:52.900807 25213 raft_consensus.cc:695] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:52.901294 25207 tablet_bootstrap.cc:492] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.901758 25207 ts_tablet_manager.cc:1397] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.053s user 0.025s sys 0.017s
I20250109 21:11:52.901535 25213 consensus_queue.cc:237] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.902743 25205 raft_consensus.cc:357] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.903506 25205 raft_consensus.cc:383] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.903788 25205 raft_consensus.cc:738] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.904351 25207 raft_consensus.cc:357] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.904457 25205 consensus_queue.cc:260] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.905985 25228 leader_election.cc:290] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:52.906996 25057 raft_consensus.cc:2463] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:52.907239 25205 ts_tablet_manager.cc:1428] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.007s user 0.007s sys 0.000s
I20250109 21:11:52.908197 25205 tablet_bootstrap.cc:492] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.909035 24873 leader_election.cc:304] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters: 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:52.909046 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5448fa51a40c48bdb4fc1bba783f069a" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:52.909837 24907 raft_consensus.cc:3054] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.910140 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5448fa51a40c48bdb4fc1bba783f069a" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:52.910737 24981 raft_consensus.cc:3054] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.912333 25206 tablet_bootstrap.cc:492] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4: No bootstrap required, opened a new log
I20250109 21:11:52.912391 25214 raft_consensus.cc:2798] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:52.912856 25206 ts_tablet_manager.cc:1397] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4: Time spent bootstrapping tablet: real 0.041s user 0.004s sys 0.020s
I20250109 21:11:52.913012 25214 raft_consensus.cc:695] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:52.914124 25214 consensus_queue.cc:237] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.915294 25206 raft_consensus.cc:357] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.915943 25206 raft_consensus.cc:383] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.916188 25206 raft_consensus.cc:738] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.905117 25207 raft_consensus.cc:383] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.916595 25207 raft_consensus.cc:738] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.916911 25206 consensus_queue.cc:260] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.917192 25207 consensus_queue.cc:260] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.919752 25206 ts_tablet_manager.cc:1428] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4: Time spent starting tablet: real 0.007s user 0.006s sys 0.002s
I20250109 21:11:52.922670 25207 ts_tablet_manager.cc:1428] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.021s user 0.007s sys 0.001s
I20250109 21:11:52.923682 25207 tablet_bootstrap.cc:492] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6: Bootstrap starting.
I20250109 21:11:52.926607 24981 raft_consensus.cc:2463] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:52.927680 25020 leader_election.cc:304] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:52.928516 25194 raft_consensus.cc:2798] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:52.929628 25205 tablet_bootstrap.cc:654] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.933607 25207 tablet_bootstrap.cc:654] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.935752 25194 raft_consensus.cc:695] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:52.936843 25194 consensus_queue.cc:237] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.922055 24907 raft_consensus.cc:2463] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:52.941710 25205 tablet_bootstrap.cc:492] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:52.942364 25205 ts_tablet_manager.cc:1397] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.034s user 0.013s sys 0.003s
I20250109 21:11:52.945309 25207 tablet_bootstrap.cc:492] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6: No bootstrap required, opened a new log
I20250109 21:11:52.945806 25207 ts_tablet_manager.cc:1397] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6: Time spent bootstrapping tablet: real 0.022s user 0.011s sys 0.006s
I20250109 21:11:52.945360 25205 raft_consensus.cc:357] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.946195 25205 raft_consensus.cc:383] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.946484 25205 raft_consensus.cc:738] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.947217 25205 consensus_queue.cc:260] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.948283 25207 raft_consensus.cc:357] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.948930 25207 raft_consensus.cc:383] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.949167 25207 raft_consensus.cc:738] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.949741 25207 consensus_queue.cc:260] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.951658 25205 ts_tablet_manager.cc:1428] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.009s user 0.008s sys 0.000s
I20250109 21:11:52.951777 25207 ts_tablet_manager.cc:1428] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:11:52.952489 25205 tablet_bootstrap.cc:492] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.960587 25205 tablet_bootstrap.cc:654] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.965806 24803 catalog_manager.cc:5526] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:52.968371 24804 catalog_manager.cc:5526] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:52.970199 25205 tablet_bootstrap.cc:492] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:52.970647 25205 ts_tablet_manager.cc:1397] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.018s user 0.007s sys 0.006s
I20250109 21:11:52.973074 25205 raft_consensus.cc:357] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.973701 25205 raft_consensus.cc:383] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:52.973979 25205 raft_consensus.cc:738] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:52.974511 25205 consensus_queue.cc:260] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.976615 25205 ts_tablet_manager.cc:1428] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.006s user 0.006s sys 0.000s
I20250109 21:11:52.976516 25194 raft_consensus.cc:491] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:52.977067 25194 raft_consensus.cc:513] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.977490 25205 tablet_bootstrap.cc:492] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49: Bootstrap starting.
I20250109 21:11:52.978825 25194 leader_election.cc:290] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:52.981552 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e210d085e81c4b1ab4e3f74ecac93cf8" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:52.982187 24907 raft_consensus.cc:2463] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:52.983246 25205 tablet_bootstrap.cc:654] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49: Neither blocks nor log segments found. Creating new log.
I20250109 21:11:52.983239 25020 leader_election.cc:304] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:52.984125 25194 raft_consensus.cc:2798] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:52.984539 25194 raft_consensus.cc:491] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:52.984850 25194 raft_consensus.cc:3054] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.986348 25213 raft_consensus.cc:491] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:52.986837 25213 raft_consensus.cc:513] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.988891 25213 leader_election.cc:290] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:52.990247 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c7d315d074c4f8fa425b5e9a96e1f70" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:52.991609 25057 raft_consensus.cc:2463] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:52.993165 24873 leader_election.cc:304] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:52.994415 25213 raft_consensus.cc:2798] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:52.994892 25213 raft_consensus.cc:491] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:52.995525 25213 raft_consensus.cc:3054] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:52.995059 25214 raft_consensus.cc:491] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:52.997638 25214 raft_consensus.cc:513] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:52.999665 25214 leader_election.cc:290] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:52.989456 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c7d315d074c4f8fa425b5e9a96e1f70" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:53.000373 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6733e937d466eb44925ad1601ba10" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:53.000725 25205 tablet_bootstrap.cc:492] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49: No bootstrap required, opened a new log
I20250109 21:11:53.001024 24983 raft_consensus.cc:2463] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:53.001386 25205 ts_tablet_manager.cc:1397] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49: Time spent bootstrapping tablet: real 0.024s user 0.012s sys 0.007s
I20250109 21:11:53.000756 24981 raft_consensus.cc:2463] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:53.003454 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6733e937d466eb44925ad1601ba10" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:53.004083 25057 raft_consensus.cc:2463] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:53.005263 24870 leader_election.cc:304] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:53.005712 24804 catalog_manager.cc:5526] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.008919 25214 raft_consensus.cc:2798] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:53.009332 25214 raft_consensus.cc:491] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:53.010522 25214 raft_consensus.cc:3054] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.011572 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e210d085e81c4b1ab4e3f74ecac93cf8" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:53.012178 24981 raft_consensus.cc:2463] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 0.
I20250109 21:11:53.005322 25194 raft_consensus.cc:513] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.018733 25194 leader_election.cc:290] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:53.019752 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e210d085e81c4b1ab4e3f74ecac93cf8" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:53.005306 25205 raft_consensus.cc:357] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Replica starting. Triggering 0 pending ops. Active config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.020330 25205 raft_consensus.cc:383] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Consensus starting up: Expiring failure detector timer to make a prompt election more likely
I20250109 21:11:53.020334 24907 raft_consensus.cc:3054] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.020658 25205 raft_consensus.cc:738] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Initialized, Role: FOLLOWER
I20250109 21:11:53.021355 25205 consensus_queue.cc:260] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 0, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.021503 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e210d085e81c4b1ab4e3f74ecac93cf8" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:53.022090 24981 raft_consensus.cc:3054] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.023048 25205 ts_tablet_manager.cc:1428] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49: Time spent starting tablet: real 0.021s user 0.005s sys 0.000s
I20250109 21:11:53.023526 25214 raft_consensus.cc:513] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.025822 25214 leader_election.cc:290] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.026710 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6733e937d466eb44925ad1601ba10" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.027339 25057 raft_consensus.cc:3054] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.028681 25214 raft_consensus.cc:491] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:53.029119 25214 raft_consensus.cc:513] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.029456 24981 raft_consensus.cc:2463] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:53.030073 24907 raft_consensus.cc:2463] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 1.
I20250109 21:11:53.030602 25020 leader_election.cc:304] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:53.031910 25194 raft_consensus.cc:2798] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:53.032459 25194 raft_consensus.cc:695] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:53.032459 25214 leader_election.cc:290] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.032667 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca9f7d9e7c60492dafa2eaf31ca18c7e" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:53.033408 25058 raft_consensus.cc:2463] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:53.031812 24983 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca9f7d9e7c60492dafa2eaf31ca18c7e" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49" is_pre_election: true
I20250109 21:11:53.033979 25057 raft_consensus.cc:2463] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:53.034277 24983 raft_consensus.cc:2463] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Leader pre-election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 0.
I20250109 21:11:53.034366 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6733e937d466eb44925ad1601ba10" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:53.033358 25194 consensus_queue.cc:237] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.034878 24981 raft_consensus.cc:3054] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.034821 24873 leader_election.cc:304] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:53.036263 24873 leader_election.cc:304] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:53.036933 25193 raft_consensus.cc:2798] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Leader pre-election won for term 1
I20250109 21:11:53.037269 25193 raft_consensus.cc:491] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Starting leader election (no leader contacted us within the election timeout)
I20250109 21:11:53.037344 25214 raft_consensus.cc:2798] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:53.037680 25193 raft_consensus.cc:3054] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.040565 24981 raft_consensus.cc:2463] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:53.009270 25213 raft_consensus.cc:513] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.045874 25213 leader_election.cc:290] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.046205 25193 raft_consensus.cc:513] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.049556 25193 leader_election.cc:290] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.049407 25214 raft_consensus.cc:695] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.050637 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca9f7d9e7c60492dafa2eaf31ca18c7e" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.051429 25058 raft_consensus.cc:3054] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.051087 25214 consensus_queue.cc:237] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.055840 24804 catalog_manager.cc:5526] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 0 to 1, leader changed from <none> to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 1 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:53.062175 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c7d315d074c4f8fa425b5e9a96e1f70" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.062752 25057 raft_consensus.cc:3054] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.060251 25058 raft_consensus.cc:2463] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:53.064337 24873 leader_election.cc:304] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:53.065668 25248 raft_consensus.cc:2798] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:53.066134 25248 raft_consensus.cc:695] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.066916 25248 consensus_queue.cc:237] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.067811 24803 catalog_manager.cc:5526] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.068825 25057 raft_consensus.cc:2463] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:53.069751 24873 leader_election.cc:304] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 1 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:53.070576 25214 raft_consensus.cc:2798] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Leader election won for term 1
I20250109 21:11:53.071029 25214 raft_consensus.cc:695] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.071817 25214 consensus_queue.cc:237] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 0.0, Last appended by leader: 0, Current term: 1, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.072181 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c7d315d074c4f8fa425b5e9a96e1f70" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:53.072726 24981 raft_consensus.cc:3054] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.077899 24982 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "ca9f7d9e7c60492dafa2eaf31ca18c7e" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:53.078130 24981 raft_consensus.cc:2463] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:53.078336 24982 raft_consensus.cc:3054] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.079407 25243 raft_consensus.cc:491] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:53.079893 25243 raft_consensus.cc:513] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.081818 25243 leader_election.cc:290] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.083753 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:53.083850 24803 catalog_manager.cc:5526] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.085642 24982 raft_consensus.cc:2463] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 1.
I20250109 21:11:53.085362 24803 catalog_manager.cc:5526] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 0 to 1, leader changed from <none> to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 1 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.084558 25057 raft_consensus.cc:2388] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4841879f5e4347918a29b974a7cadd49 in current term 1: Already voted for candidate ef0ecd709a624128b4513100dfc72fc6 in this term.
I20250109 21:11:53.086942 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:53.088925 24949 leader_election.cc:304] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49; no voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:53.089489 25178 raft_consensus.cc:3054] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.094796 25178 raft_consensus.cc:2743] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:53.133134 25243 raft_consensus.cc:491] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election (no leader contacted us within the election timeout)
I20250109 21:11:53.133518 25243 raft_consensus.cc:513] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Starting pre-election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.134967 25243 leader_election.cc:290] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Requested pre-vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.135564 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6008039b2a714bada9232df36acf69ea" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "ef0ecd709a624128b4513100dfc72fc6" is_pre_election: true
I20250109 21:11:53.135850 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "6008039b2a714bada9232df36acf69ea" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 1 candidate_status { last_received { term: 0 index: 0 } } ignore_live_leader: false dest_uuid: "5623262d5bc949f7907acb0a7215d9b4" is_pre_election: true
I20250109 21:11:53.136591 25057 raft_consensus.cc:2388] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Leader pre-election vote request: Denying vote to candidate 4841879f5e4347918a29b974a7cadd49 in current term 1: Already voted for candidate ef0ecd709a624128b4513100dfc72fc6 in this term.
I20250109 21:11:53.137316 24949 leader_election.cc:304] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 1 pre-election: Election decided. Result: candidate lost. Election summary: received 3 responses out of 3 voters: 1 yes votes; 2 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49; no voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:53.137943 25243 raft_consensus.cc:3054] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 0 FOLLOWER]: Advancing to term 1
I20250109 21:11:53.143110 25243 raft_consensus.cc:2743] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Leader pre-election lost for term 1. Reason: could not achieve majority
I20250109 21:11:53.183961 25214 consensus_queue.cc:1035] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.194011 25214 consensus_queue.cc:1035] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.260610 25057 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3db5be22d5e44289a4f05e0472013e31"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
mode: GRACEFUL
new_leader_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:33054
I20250109 21:11:53.261054 25057 raft_consensus.cc:604] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Received request to transfer leadership to TS ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:53.267838 25058 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5448fa51a40c48bdb4fc1bba783f069a"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
mode: GRACEFUL
new_leader_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:33054
I20250109 21:11:53.268419 25058 raft_consensus.cc:604] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Received request to transfer leadership to TS ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:53.274636 25058 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "e210d085e81c4b1ab4e3f74ecac93cf8"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
mode: GRACEFUL
new_leader_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:33054
I20250109 21:11:53.275080 25058 raft_consensus.cc:604] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Received request to transfer leadership to TS 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:53.292162 24907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "f741922802204b7f9899054395f6bedf"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
mode: GRACEFUL
new_leader_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:40474
I20250109 21:11:53.292641 24907 raft_consensus.cc:604] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Received request to transfer leadership to TS 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:53.296676 24907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
mode: GRACEFUL
new_leader_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:40474
I20250109 21:11:53.297072 24907 raft_consensus.cc:604] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Received request to transfer leadership to TS 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:53.301183 24907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "18e6733e937d466eb44925ad1601ba10"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
mode: GRACEFUL
new_leader_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:40474
I20250109 21:11:53.301577 24907 raft_consensus.cc:604] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Received request to transfer leadership to TS 4841879f5e4347918a29b974a7cadd49
I20250109 21:11:53.305442 24907 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "5c7d315d074c4f8fa425b5e9a96e1f70"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
mode: GRACEFUL
new_leader_uuid: "5623262d5bc949f7907acb0a7215d9b4"
from {username='slave'} at 127.0.0.1:40474
I20250109 21:11:53.305821 24907 raft_consensus.cc:604] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Received request to transfer leadership to TS 5623262d5bc949f7907acb0a7215d9b4
I20250109 21:11:53.316627 25214 consensus_queue.cc:1035] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.325291 25214 consensus_queue.cc:1035] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.331736 25248 raft_consensus.cc:988] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6: : Instructing follower 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:53.332162 25214 raft_consensus.cc:1076] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Signalling peer 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:53.333627 24982 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:44938
I20250109 21:11:53.334220 24982 raft_consensus.cc:491] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:53.334475 24982 raft_consensus.cc:3054] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.339083 24982 raft_consensus.cc:513] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.340368 24982 leader_election.cc:290] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.341264 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:53.341303 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "4e06275a29b34e0b9773456bfb5b5954" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.341908 24907 raft_consensus.cc:3049] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:53.342017 25058 raft_consensus.cc:3054] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.342233 24907 raft_consensus.cc:738] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.343036 24907 consensus_queue.cc:260] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.343935 24907 raft_consensus.cc:3054] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.347451 25058 raft_consensus.cc:2463] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:53.348261 24949 leader_election.cc:304] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:53.348771 24907 raft_consensus.cc:2463] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:53.348870 25243 raft_consensus.cc:2798] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:53.349449 25243 raft_consensus.cc:695] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:53.350225 25243 consensus_queue.cc:237] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.355720 24803 catalog_manager.cc:5526] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 1 to 2, leader changed from ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193) to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.361588 25194 consensus_queue.cc:1035] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.367240 25238 raft_consensus.cc:988] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4: : Instructing follower ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:53.367668 25238 raft_consensus.cc:1076] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Signalling peer ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:53.369472 24908 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3db5be22d5e44289a4f05e0472013e31"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:40448
I20250109 21:11:53.370033 24908 raft_consensus.cc:491] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:53.370352 24908 raft_consensus.cc:3054] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.372805 25194 consensus_queue.cc:1035] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.377364 24908 raft_consensus.cc:513] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.378422 24907 raft_consensus.cc:1235] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 5623262d5bc949f7907acb0a7215d9b4 for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:53.379940 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db5be22d5e44289a4f05e0472013e31" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:53.380535 24981 raft_consensus.cc:3054] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.383296 25194 consensus_queue.cc:1046] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.384069 25238 raft_consensus.cc:3049] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:53.384393 25238 raft_consensus.cc:738] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:53.385172 25238 consensus_queue.cc:260] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.385681 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3db5be22d5e44289a4f05e0472013e31" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.386338 25238 raft_consensus.cc:3054] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.386404 24908 leader_election.cc:290] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.387305 24981 raft_consensus.cc:2463] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:53.388247 24870 leader_election.cc:304] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:53.389139 25248 raft_consensus.cc:2798] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:53.389571 25248 raft_consensus.cc:695] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.390300 25248 consensus_queue.cc:237] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.392185 25214 consensus_queue.cc:1035] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.398902 25058 raft_consensus.cc:2463] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:53.401806 24804 catalog_manager.cc:5526] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 1 to 2, leader changed from 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195) to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.403213 25193 raft_consensus.cc:988] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6: : Instructing follower 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:53.403681 25248 raft_consensus.cc:1076] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Signalling peer 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:53.405809 24982 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "f741922802204b7f9899054395f6bedf"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:44938
I20250109 21:11:53.407404 24982 raft_consensus.cc:491] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:53.407763 24982 raft_consensus.cc:3054] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.408026 25214 consensus_queue.cc:1035] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.413384 24982 raft_consensus.cc:513] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.417562 24982 leader_election.cc:290] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.421000 25238 consensus_queue.cc:1035] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.421604 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f741922802204b7f9899054395f6bedf" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.422169 25058 raft_consensus.cc:3054] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.427441 25228 raft_consensus.cc:988] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4: : Instructing follower 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:53.427882 25194 raft_consensus.cc:1076] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Signalling peer 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:53.429258 24981 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "e210d085e81c4b1ab4e3f74ecac93cf8"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:44930
I20250109 21:11:53.429740 24908 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "f741922802204b7f9899054395f6bedf" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:53.430311 24908 raft_consensus.cc:3049] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:53.430611 24908 raft_consensus.cc:738] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.431592 24981 raft_consensus.cc:491] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:53.431385 24908 consensus_queue.cc:260] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.431951 24981 raft_consensus.cc:3054] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.432682 24908 raft_consensus.cc:3054] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.432451 25194 consensus_queue.cc:1035] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.437937 24981 raft_consensus.cc:513] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.442454 24906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e210d085e81c4b1ab4e3f74ecac93cf8" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:53.442554 24981 leader_election.cc:290] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.442739 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "e210d085e81c4b1ab4e3f74ecac93cf8" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.443356 25057 raft_consensus.cc:3049] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:53.443704 25057 raft_consensus.cc:738] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:53.444433 25057 consensus_queue.cc:260] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.445447 25057 raft_consensus.cc:3054] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.451303 25058 raft_consensus.cc:2463] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:53.452186 24949 leader_election.cc:304] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:53.452979 25243 raft_consensus.cc:2798] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:53.453439 25243 raft_consensus.cc:695] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:53.454209 25243 consensus_queue.cc:237] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.454803 25194 consensus_queue.cc:1035] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.456424 25057 raft_consensus.cc:2463] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:53.457468 24949 leader_election.cc:304] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters: ef0ecd709a624128b4513100dfc72fc6
I20250109 21:11:53.458360 25243 raft_consensus.cc:2798] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:53.458793 25243 raft_consensus.cc:695] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:53.459444 25243 consensus_queue.cc:237] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.461378 24908 raft_consensus.cc:2463] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:53.465950 25228 raft_consensus.cc:988] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: : Instructing follower ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:53.466378 25228 raft_consensus.cc:1076] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Signalling peer ef0ecd709a624128b4513100dfc72fc6 to start an election
I20250109 21:11:53.466894 24804 catalog_manager.cc:5526] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 1 to 2, leader changed from ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193) to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.469880 25228 consensus_queue.cc:1035] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.470006 24908 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5448fa51a40c48bdb4fc1bba783f069a"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
from {username='slave'} at 127.0.0.1:40448
I20250109 21:11:53.470546 24908 raft_consensus.cc:491] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:53.470891 24908 raft_consensus.cc:3054] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.476198 24908 raft_consensus.cc:513] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.476979 24907 raft_consensus.cc:1235] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Rejecting Update request from peer 5623262d5bc949f7907acb0a7215d9b4 for earlier term 1. Current term is 2. Ops: []
I20250109 21:11:53.468984 24804 catalog_manager.cc:5526] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 1 to 2, leader changed from 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195) to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.478384 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5448fa51a40c48bdb4fc1bba783f069a" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:53.478716 25058 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5448fa51a40c48bdb4fc1bba783f069a" candidate_uuid: "ef0ecd709a624128b4513100dfc72fc6" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.478936 24981 raft_consensus.cc:3054] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.478885 25194 consensus_queue.cc:1046] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Peer responded invalid term: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: INVALID_TERM, Last received: 1.1, Next index: 2, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.479746 25058 raft_consensus.cc:3049] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:53.480027 25058 raft_consensus.cc:738] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:53.480661 25058 consensus_queue.cc:260] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.481647 25058 raft_consensus.cc:3054] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.484393 24981 raft_consensus.cc:2463] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
I20250109 21:11:53.485049 24908 leader_election.cc:290] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Requested vote from peers 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.485616 24870 leader_election.cc:304] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:53.486353 25248 raft_consensus.cc:2798] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:53.486797 25248 raft_consensus.cc:695] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Becoming Leader. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.487540 25248 consensus_queue.cc:237] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 0, Committed index: 0, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.492380 25058 raft_consensus.cc:2463] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate ef0ecd709a624128b4513100dfc72fc6 in term 2.
W20250109 21:11:53.492923 25228 raft_consensus.cc:931] Couldn't advance consensus term.: Illegal state: Can't advance term to: 2 current term: 2 is higher.
I20250109 21:11:53.496250 24803 catalog_manager.cc:5526] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 reported cstate change: term changed from 1 to 2, leader changed from 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195) to ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193). New cstate: current_term: 2 leader_uuid: "ef0ecd709a624128b4513100dfc72fc6" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.508085 25248 consensus_queue.cc:1035] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.516319 25248 consensus_queue.cc:1035] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.524745 25247 raft_consensus.cc:988] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6: : Instructing follower 5623262d5bc949f7907acb0a7215d9b4 to start an election
I20250109 21:11:53.525164 25248 raft_consensus.cc:1076] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Signalling peer 5623262d5bc949f7907acb0a7215d9b4 to start an election
I20250109 21:11:53.526618 25058 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "5c7d315d074c4f8fa425b5e9a96e1f70"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
from {username='slave'} at 127.0.0.1:33036
I20250109 21:11:53.527128 25058 raft_consensus.cc:491] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:53.527418 25058 raft_consensus.cc:3054] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.531785 25058 raft_consensus.cc:513] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.533149 25058 leader_election.cc:290] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:53.533855 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c7d315d074c4f8fa425b5e9a96e1f70" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:53.534039 24981 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "5c7d315d074c4f8fa425b5e9a96e1f70" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:53.534500 24907 raft_consensus.cc:3049] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:53.534621 24981 raft_consensus.cc:3054] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.534874 24907 raft_consensus.cc:738] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.535794 24907 consensus_queue.cc:260] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.537001 24907 raft_consensus.cc:3054] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.539077 24981 raft_consensus.cc:2463] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 2.
I20250109 21:11:53.539897 25020 leader_election.cc:304] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:53.540647 25228 raft_consensus.cc:2798] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:53.541062 25228 raft_consensus.cc:695] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:53.541752 25228 consensus_queue.cc:237] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.542313 24907 raft_consensus.cc:2463] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 2.
I20250109 21:11:53.547230 24805 catalog_manager.cc:5526] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 1 to 2, leader changed from ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193) to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:53.613911 25193 consensus_queue.cc:1035] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.615644 25248 consensus_queue.cc:1035] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.630364 25193 raft_consensus.cc:988] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6: : Instructing follower 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:53.630795 25193 raft_consensus.cc:1076] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Signalling peer 4841879f5e4347918a29b974a7cadd49 to start an election
I20250109 21:11:53.633343 24982 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "18e6733e937d466eb44925ad1601ba10"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
from {username='slave'} at 127.0.0.1:44938
I20250109 21:11:53.634071 24982 raft_consensus.cc:491] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:53.634428 24982 raft_consensus.cc:3054] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.636211 25247 consensus_queue.cc:1035] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.637759 25247 consensus_queue.cc:1035] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 1, Last known committed idx: 0, Time since last communication: 0.000s
I20250109 21:11:53.642201 24982 raft_consensus.cc:513] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.648308 24982 leader_election.cc:290] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195:44027)
I20250109 21:11:53.648741 25057 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6733e937d466eb44925ad1601ba10" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
I20250109 21:11:53.650559 24907 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "18e6733e937d466eb44925ad1601ba10" candidate_uuid: "4841879f5e4347918a29b974a7cadd49" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:53.651561 24907 raft_consensus.cc:3049] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:53.653218 24907 raft_consensus.cc:738] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:53.654076 24907 consensus_queue.cc:260] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.655287 24907 raft_consensus.cc:3054] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.662930 24907 raft_consensus.cc:2463] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 4841879f5e4347918a29b974a7cadd49 in term 2.
I20250109 21:11:53.663761 24946 leader_election.cc:304] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 3 responses out of 3 voters: 2 yes votes; 1 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, ef0ecd709a624128b4513100dfc72fc6; no voters: 5623262d5bc949f7907acb0a7215d9b4
I20250109 21:11:53.664366 25243 raft_consensus.cc:2798] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:53.664741 25243 raft_consensus.cc:695] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Becoming Leader. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:53.665402 25243 consensus_queue.cc:237] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:53.671150 24804 catalog_manager.cc:5526] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 reported cstate change: term changed from 1 to 2, leader changed from ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193) to 4841879f5e4347918a29b974a7cadd49 (127.19.136.194). New cstate: current_term: 2 leader_uuid: "4841879f5e4347918a29b974a7cadd49" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:53.767957 25058 raft_consensus.cc:1270] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.769014 25243 consensus_queue.cc:1035] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.773609 25058 raft_consensus.cc:1270] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.775880 25248 consensus_queue.cc:1035] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.776108 24907 raft_consensus.cc:1270] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.779673 25178 consensus_queue.cc:1035] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.786700 24981 raft_consensus.cc:1270] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.791002 25247 consensus_queue.cc:1035] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.951649 25058 raft_consensus.cc:1270] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.952687 25193 consensus_queue.cc:1035] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.956723 24907 raft_consensus.cc:3054] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:53.960052 24981 raft_consensus.cc:1270] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Refusing update from remote peer ef0ecd709a624128b4513100dfc72fc6: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.961654 25248 consensus_queue.cc:1035] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.966279 24907 raft_consensus.cc:1270] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.967325 25275 consensus_queue.cc:1035] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.970088 24907 raft_consensus.cc:1270] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.971608 25243 consensus_queue.cc:1035] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.978021 25058 raft_consensus.cc:1270] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.979197 25178 consensus_queue.cc:1035] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:53.983249 25058 raft_consensus.cc:1270] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:53.985287 25275 consensus_queue.cc:1035] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:54.003398 24908 raft_consensus.cc:1270] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 5623262d5bc949f7907acb0a7215d9b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:54.004407 25194 consensus_queue.cc:1035] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:54.010694 24981 raft_consensus.cc:1270] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Refusing update from remote peer 5623262d5bc949f7907acb0a7215d9b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:54.012171 25228 consensus_queue.cc:1035] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:54.263371 24908 raft_consensus.cc:1270] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:54.264374 25178 consensus_queue.cc:1035] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:54.270185 25057 raft_consensus.cc:3054] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:54.276755 25057 raft_consensus.cc:1270] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Refusing update from remote peer 4841879f5e4347918a29b974a7cadd49: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:54.277782 25178 consensus_queue.cc:1035] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [LEADER]: Connected to new peer: Peer: permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:56.308590 24804 catalog_manager.cc:2462] Servicing SoftDeleteTable request from {username='slave'} at 127.0.0.1:54326:
table { table_name: "soft_deleted_table" } modify_external_catalogs: true reserve_seconds: 3600
I20250109 21:11:56.332429 24804 catalog_manager.cc:3344] Servicing AlterTable request from {username='slave'} at 127.0.0.1:54326:
table { table_name: "soft_deleted_table" } new_extra_configs { key: "kudu.table.disable_compaction" value: "true" }
I20250109 21:11:56.354530 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
W20250109 21:11:56.575304 24949 outbound_call.cc:321] RPC callback for RPC call kudu.consensus.ConsensusService.UpdateConsensus -> {remote=127.19.136.195:44027, user_credentials={real_user=slave}} blocked reactor thread for 68128us
I20250109 21:11:56.616225 24982 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "3b36c529424042cca5930cbea746ee97"
dest_uuid: "4841879f5e4347918a29b974a7cadd49"
mode: GRACEFUL
new_leader_uuid: "5623262d5bc949f7907acb0a7215d9b4"
from {username='slave'} at 127.0.0.1:44954
I20250109 21:11:56.622611 25326 tablet.cc:1721] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.690645 25332 tablet.cc:1721] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.624783 24982 raft_consensus.cc:604] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Received request to transfer leadership to TS 5623262d5bc949f7907acb0a7215d9b4
I20250109 21:11:56.694072 25335 tablet.cc:1721] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.736505 25331 tablet.cc:1721] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.720795 25327 tablet.cc:1721] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
W20250109 21:11:56.744503 25320 log.cc:926] Time spent T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: Append to log took a long time: real 0.136s user 0.001s sys 0.000s
I20250109 21:11:56.751511 25333 tablet.cc:1721] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.771096 25338 tablet.cc:1721] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.804297 25332 tablet.cc:1721] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.891722 25345 tablet.cc:1721] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.902637 25243 raft_consensus.cc:988] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49: : Instructing follower 5623262d5bc949f7907acb0a7215d9b4 to start an election
I20250109 21:11:56.904421 25333 tablet.cc:1721] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.903245 25243 raft_consensus.cc:1076] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Signalling peer 5623262d5bc949f7907acb0a7215d9b4 to start an election
I20250109 21:11:56.909226 25331 tablet.cc:1721] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.911123 25054 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "3b36c529424042cca5930cbea746ee97"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
from {username='slave'} at 127.0.0.1:33046
I20250109 21:11:56.911759 25054 raft_consensus.cc:491] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:56.912320 25054 raft_consensus.cc:3054] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:56.914561 25342 tablet.cc:1721] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.916507 25346 tablet.cc:1721] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.923035 25344 tablet.cc:1721] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.926786 25333 tablet.cc:1721] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.928817 25332 tablet.cc:1721] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.929348 25343 tablet.cc:1721] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.944885 25338 tablet.cc:1721] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.950194 25327 tablet.cc:1721] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.958077 25344 tablet.cc:1721] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.925072 25335 tablet.cc:1721] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.967298 24906 tablet_service.cc:1967] Received LeaderStepDown RPC: tablet_id: "c61207388546489497ba5192615f7ddc"
dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
mode: GRACEFUL
new_leader_uuid: "5623262d5bc949f7907acb0a7215d9b4"
from {username='slave'} at 127.0.0.1:40478
I20250109 21:11:56.978950 25342 tablet.cc:1721] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.979600 24906 raft_consensus.cc:604] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Received request to transfer leadership to TS 5623262d5bc949f7907acb0a7215d9b4
I20250109 21:11:56.980759 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 2
I20250109 21:11:56.971180 25346 tablet.cc:1721] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.981447 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:56.981200 25054 raft_consensus.cc:513] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:56.983058 25338 tablet.cc:1721] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.984174 24906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b36c529424042cca5930cbea746ee97" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:56.984979 24906 raft_consensus.cc:3054] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:56.987594 25327 tablet.cc:1721] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.995780 24906 raft_consensus.cc:2463] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 2.
I20250109 21:11:56.996133 25343 tablet.cc:1721] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:56.997247 25020 leader_election.cc:304] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 2 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 5623262d5bc949f7907acb0a7215d9b4, ef0ecd709a624128b4513100dfc72fc6; no voters:
I20250109 21:11:56.998399 25319 raft_consensus.cc:2798] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Leader election won for term 2
I20250109 21:11:56.998836 25319 raft_consensus.cc:695] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:56.999833 25319 consensus_queue.cc:237] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 2, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:56.966890 25345 tablet.cc:1721] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4: Alter schema from (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 0 to (
10:key INT32 NOT NULL,
11:int_val INT32 NOT NULL,
12:string_val STRING NULLABLE,
PRIMARY KEY (key)
) version 1
I20250109 21:11:57.013702 24978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "3b36c529424042cca5930cbea746ee97" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 2 candidate_status { last_received { term: 1 index: 1 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:57.014469 24978 raft_consensus.cc:3049] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Stepping down as leader of term 1
I20250109 21:11:57.014791 24978 raft_consensus.cc:738] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Becoming Follower/Learner. State: Replica: 4841879f5e4347918a29b974a7cadd49, State: Running, Role: LEADER
I20250109 21:11:57.015379 25054 leader_election.cc:290] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 2 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:57.015799 24978 consensus_queue.cc:260] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 1, Committed index: 1, Last appended: 1.1, Last appended by leader: 1, Current term: 1, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } }
I20250109 21:11:57.017361 24978 raft_consensus.cc:3054] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Advancing to term 2
I20250109 21:11:57.024161 24978 raft_consensus.cc:2463] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 2.
I20250109 21:11:57.025336 24805 catalog_manager.cc:6071] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7: soft_deleted_table [id=11d1ad673e584537b5de398ee6f3fde8] alter complete (version 1)
I20250109 21:11:57.040163 24801 catalog_manager.cc:5526] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 1 to 2, leader changed from 4841879f5e4347918a29b974a7cadd49 (127.19.136.194) to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 2 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } }
I20250109 21:11:57.466034 24978 raft_consensus.cc:1270] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Refusing update from remote peer 5623262d5bc949f7907acb0a7215d9b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:57.467044 25319 consensus_queue.cc:1035] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:57.478613 24906 raft_consensus.cc:1270] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Refusing update from remote peer 5623262d5bc949f7907acb0a7215d9b4: Log matching property violated. Preceding OpId in replica: term: 1 index: 1. Preceding OpId from leader: term: 2 index: 2. (index mismatch)
I20250109 21:11:57.479910 25319 consensus_queue.cc:1035] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 2, Last known committed idx: 1, Time since last communication: 0.000s
I20250109 21:11:57.492498 25294 raft_consensus.cc:988] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6: : Instructing follower 5623262d5bc949f7907acb0a7215d9b4 to start an election
I20250109 21:11:57.492952 25361 raft_consensus.cc:1076] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Signalling peer 5623262d5bc949f7907acb0a7215d9b4 to start an election
I20250109 21:11:57.494395 25054 tablet_service.cc:1939] Received Run Leader Election RPC: tablet_id: "c61207388546489497ba5192615f7ddc"
dest_uuid: "5623262d5bc949f7907acb0a7215d9b4"
from {username='slave'} at 127.0.0.1:33036
I20250109 21:11:57.494829 25054 raft_consensus.cc:491] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Starting forced leader election (received explicit request)
I20250109 21:11:57.495117 25054 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:57.500113 25054 raft_consensus.cc:513] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 3 FOLLOWER]: Starting forced leader election with config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:57.501529 25054 leader_election.cc:290] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 3 election: Requested vote from peers ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187), 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007)
I20250109 21:11:57.502252 24906 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61207388546489497ba5192615f7ddc" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "ef0ecd709a624128b4513100dfc72fc6"
I20250109 21:11:57.502307 24978 tablet_service.cc:1812] Received RequestConsensusVote() RPC: tablet_id: "c61207388546489497ba5192615f7ddc" candidate_uuid: "5623262d5bc949f7907acb0a7215d9b4" candidate_term: 3 candidate_status { last_received { term: 2 index: 2 } } ignore_live_leader: true dest_uuid: "4841879f5e4347918a29b974a7cadd49"
I20250109 21:11:57.502849 24906 raft_consensus.cc:3049] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Stepping down as leader of term 2
I20250109 21:11:57.502977 24978 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:57.503191 24906 raft_consensus.cc:738] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Becoming Follower/Learner. State: Replica: ef0ecd709a624128b4513100dfc72fc6, State: Running, Role: LEADER
I20250109 21:11:57.503942 24906 consensus_queue.cc:260] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [NON_LEADER]: Queue going to NON_LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 2, Majority size: -1, State: 0, Mode: NON_LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:57.504931 24906 raft_consensus.cc:3054] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Advancing to term 3
I20250109 21:11:57.508209 24978 raft_consensus.cc:2463] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 3.
I20250109 21:11:57.509476 25020 leader_election.cc:304] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [CANDIDATE]: Term 3 election: Election decided. Result: candidate won. Election summary: received 2 responses out of 3 voters: 2 yes votes; 0 no votes. yes voters: 4841879f5e4347918a29b974a7cadd49, 5623262d5bc949f7907acb0a7215d9b4; no voters:
I20250109 21:11:57.510190 25319 raft_consensus.cc:2798] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 3 FOLLOWER]: Leader election won for term 3
I20250109 21:11:57.510329 24906 raft_consensus.cc:2463] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 3 FOLLOWER]: Leader election vote request: Granting yes vote for candidate 5623262d5bc949f7907acb0a7215d9b4 in term 3.
I20250109 21:11:57.510679 25319 raft_consensus.cc:695] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 3 LEADER]: Becoming Leader. State: Replica: 5623262d5bc949f7907acb0a7215d9b4, State: Running, Role: LEADER
I20250109 21:11:57.511687 25319 consensus_queue.cc:237] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Queue going to LEADER mode. State: All replicated index: 0, Majority replicated index: 2, Committed index: 2, Last appended: 2.2, Last appended by leader: 2, Current term: 3, Majority size: 2, State: 0, Mode: LEADER, active raft config: opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } }
I20250109 21:11:57.519419 24805 catalog_manager.cc:5526] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 reported cstate change: term changed from 2 to 3, leader changed from ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193) to 5623262d5bc949f7907acb0a7215d9b4 (127.19.136.195). New cstate: current_term: 3 leader_uuid: "5623262d5bc949f7907acb0a7215d9b4" committed_config { opid_index: -1 OBSOLETE_local: false peers { permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 } health_report { overall_health: UNKNOWN } } peers { permanent_uuid: "5623262d5bc949f7907acb0a7215d9b4" member_type: VOTER last_known_addr { host: "127.19.136.195" port: 44027 } health_report { overall_health: HEALTHY } } peers { permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 } health_report { overall_health: UNKNOWN } } }
I20250109 21:11:57.963598 24978 raft_consensus.cc:1270] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 3 FOLLOWER]: Refusing update from remote peer 5623262d5bc949f7907acb0a7215d9b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:57.964601 25323 consensus_queue.cc:1035] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "4841879f5e4347918a29b974a7cadd49" member_type: VOTER last_known_addr { host: "127.19.136.194" port: 34007 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:57.973485 24906 raft_consensus.cc:1270] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 3 FOLLOWER]: Refusing update from remote peer 5623262d5bc949f7907acb0a7215d9b4: Log matching property violated. Preceding OpId in replica: term: 2 index: 2. Preceding OpId from leader: term: 3 index: 3. (index mismatch)
I20250109 21:11:57.975106 25364 consensus_queue.cc:1035] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [LEADER]: Connected to new peer: Peer: permanent_uuid: "ef0ecd709a624128b4513100dfc72fc6" member_type: VOTER last_known_addr { host: "127.19.136.193" port: 46187 }, Status: LMP_MISMATCH, Last received: 0.0, Next index: 3, Last known committed idx: 2, Time since last communication: 0.000s
I20250109 21:11:57.982578 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:57.988376 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:57.988946 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:58.989805 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:11:58.995214 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:11:58.995678 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:11:59.996467 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:12:00.002843 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:12:00.003386 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:12:01.004287 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:12:01.011198 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:12:01.011592 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:12:02.012328 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:12:02.017422 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:12:02.017767 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:12:03.018491 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:12:03.023383 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:12:03.023806 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:12:04.024606 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:12:04.029381 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:12:04.029822 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:12:05.032756 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:12:05.042331 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:12:05.042698 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:12:06.043412 20003 auto_leader_rebalancer.cc:140] leader rebalance for table test-workload
I20250109 21:12:06.048292 20003 auto_leader_rebalancer.cc:388] table: test-workload, leader rebalance finish, leader transfer count: 0
I20250109 21:12:06.048645 20003 auto_leader_rebalancer.cc:450] All tables' leader rebalancing finished this round
I20250109 21:12:07.097558 20003 tablet_server.cc:178] TabletServer@127.19.136.193:0 shutting down...
I20250109 21:12:07.134377 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:12:07.137073 20003 tablet_replica.cc:331] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.138106 20003 raft_consensus.cc:2238] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.139122 20003 raft_consensus.cc:2267] T ca9f7d9e7c60492dafa2eaf31ca18c7e P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.141527 20003 tablet_replica.cc:331] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.142315 20003 raft_consensus.cc:2238] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.142879 20003 raft_consensus.cc:2267] T 18e6733e937d466eb44925ad1601ba10 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.145006 20003 tablet_replica.cc:331] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.145584 20003 raft_consensus.cc:2238] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.146143 20003 raft_consensus.cc:2267] T 4e06275a29b34e0b9773456bfb5b5954 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.148361 20003 tablet_replica.cc:331] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.148928 20003 raft_consensus.cc:2238] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.149386 20003 raft_consensus.cc:2267] T 5c7d315d074c4f8fa425b5e9a96e1f70 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.151470 20003 tablet_replica.cc:331] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.151942 20003 raft_consensus.cc:2238] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.152788 20003 raft_consensus.cc:2267] T 5448fa51a40c48bdb4fc1bba783f069a P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.154793 20003 tablet_replica.cc:331] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.155341 20003 raft_consensus.cc:2238] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.156211 20003 raft_consensus.cc:2267] T 6008039b2a714bada9232df36acf69ea P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.158188 20003 tablet_replica.cc:331] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.158690 20003 raft_consensus.cc:2238] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.159485 20003 raft_consensus.cc:2267] T 3db5be22d5e44289a4f05e0472013e31 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.161413 20003 tablet_replica.cc:331] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.161912 20003 raft_consensus.cc:2238] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.162329 20003 raft_consensus.cc:2267] T 3b36c529424042cca5930cbea746ee97 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.164304 20003 tablet_replica.cc:331] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.164862 20003 raft_consensus.cc:2238] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.165354 20003 raft_consensus.cc:2267] T 8fe14f975aa84664bb0ed6080d7c89e4 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.167515 20003 tablet_replica.cc:331] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.168062 20003 raft_consensus.cc:2238] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.168521 20003 raft_consensus.cc:2267] T e7c28f7e01f64c90a201ea5904bb178f P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.170547 20003 tablet_replica.cc:331] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.171056 20003 raft_consensus.cc:2238] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.171542 20003 raft_consensus.cc:2267] T f741922802204b7f9899054395f6bedf P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.173437 20003 tablet_replica.cc:331] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.173966 20003 raft_consensus.cc:2238] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.174417 20003 raft_consensus.cc:2267] T c61207388546489497ba5192615f7ddc P ef0ecd709a624128b4513100dfc72fc6 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.176503 20003 tablet_replica.cc:331] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.177018 20003 raft_consensus.cc:2238] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.177518 20003 raft_consensus.cc:2267] T e210d085e81c4b1ab4e3f74ecac93cf8 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.179673 20003 tablet_replica.cc:331] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.180178 20003 raft_consensus.cc:2238] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.180974 20003 raft_consensus.cc:2267] T b0708b4b9a5c43959b1b3d303115fad9 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.183039 20003 tablet_replica.cc:331] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.183523 20003 raft_consensus.cc:2238] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.183948 20003 raft_consensus.cc:2267] T e2c33c211712430888fa872f1226d799 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.185999 20003 tablet_replica.cc:331] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.186427 20003 raft_consensus.cc:2238] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.186897 20003 raft_consensus.cc:2267] T 8e2535f2645d4849b03aeeb84682f73e P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.189518 20003 tablet_replica.cc:331] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.190197 20003 raft_consensus.cc:2238] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.191367 20003 raft_consensus.cc:2267] T 4df8bcc17f3d4430b1eebf02c2e60c52 P ef0ecd709a624128b4513100dfc72fc6 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:12:07.192170 24946 proxy.cc:239] Call had error, refreshing address and retrying: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer [suppressed 20 similar messages]
I20250109 21:12:07.194089 20003 tablet_replica.cc:331] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6: stopping tablet replica
I20250109 21:12:07.194801 20003 raft_consensus.cc:2238] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 1 LEADER]: Raft consensus shutting down.
W20250109 21:12:07.195350 24946 consensus_peers.cc:487] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 -> Peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Couldn't send request to peer ef0ecd709a624128b4513100dfc72fc6. Status: Remote error: Service unavailable: service kudu.consensus.ConsensusService not registered on TabletServer. This is attempt 1: this message will repeat every 5th retry.
I20250109 21:12:07.195916 20003 raft_consensus.cc:2267] T 36bf434726e740a1a55bb757ea6c7a04 P ef0ecd709a624128b4513100dfc72fc6 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.238838 20003 tablet_server.cc:195] TabletServer@127.19.136.193:0 shutdown complete.
W20250109 21:12:07.254685 24946 consensus_peers.cc:487] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 -> Peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Couldn't send request to peer ef0ecd709a624128b4513100dfc72fc6. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:12:07.262189 24946 consensus_peers.cc:487] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 -> Peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Couldn't send request to peer ef0ecd709a624128b4513100dfc72fc6. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
W20250109 21:12:07.285806 24946 consensus_peers.cc:487] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 -> Peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Couldn't send request to peer ef0ecd709a624128b4513100dfc72fc6. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:12:07.286284 20003 tablet_server.cc:178] TabletServer@127.19.136.194:0 shutting down...
W20250109 21:12:07.301882 25020 consensus_peers.cc:487] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 -> Peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Couldn't send request to peer ef0ecd709a624128b4513100dfc72fc6. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:12:07.318536 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:12:07.319394 20003 tablet_replica.cc:331] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.320530 20003 raft_consensus.cc:2238] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.321502 20003 raft_consensus.cc:2267] T 4e06275a29b34e0b9773456bfb5b5954 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.323676 20003 tablet_replica.cc:331] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.324179 20003 raft_consensus.cc:2238] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.324641 20003 raft_consensus.cc:2267] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.326546 20003 tablet_replica.cc:331] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.327139 20003 raft_consensus.cc:2238] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.327870 20003 raft_consensus.cc:2267] T 18e6733e937d466eb44925ad1601ba10 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.329777 20003 tablet_replica.cc:331] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.330250 20003 raft_consensus.cc:2238] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.330665 20003 raft_consensus.cc:2267] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.332495 20003 tablet_replica.cc:331] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.333005 20003 raft_consensus.cc:2238] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.333415 20003 raft_consensus.cc:2267] T 6008039b2a714bada9232df36acf69ea P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.335412 20003 tablet_replica.cc:331] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.335997 20003 raft_consensus.cc:2238] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.336725 20003 raft_consensus.cc:2267] T 5448fa51a40c48bdb4fc1bba783f069a P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:12:07.339056 24946 consensus_peers.cc:487] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 -> Peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Couldn't send request to peer ef0ecd709a624128b4513100dfc72fc6. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:12:07.339501 20003 tablet_replica.cc:331] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.340071 20003 raft_consensus.cc:2238] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.340471 20003 raft_consensus.cc:2267] T 3db5be22d5e44289a4f05e0472013e31 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.342453 20003 tablet_replica.cc:331] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.342954 20003 raft_consensus.cc:2238] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.343748 20003 raft_consensus.cc:2267] T e210d085e81c4b1ab4e3f74ecac93cf8 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.345750 20003 tablet_replica.cc:331] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.346222 20003 raft_consensus.cc:2238] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.346993 20003 raft_consensus.cc:2267] T e2c33c211712430888fa872f1226d799 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.348748 20003 tablet_replica.cc:331] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.349233 20003 raft_consensus.cc:2238] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.349635 20003 raft_consensus.cc:2267] T b0708b4b9a5c43959b1b3d303115fad9 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.351455 20003 tablet_replica.cc:331] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.351871 20003 raft_consensus.cc:2238] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.352278 20003 raft_consensus.cc:2267] T e7c28f7e01f64c90a201ea5904bb178f P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.354192 20003 tablet_replica.cc:331] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.354648 20003 raft_consensus.cc:2238] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.355381 20003 raft_consensus.cc:2267] T 8fe14f975aa84664bb0ed6080d7c89e4 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.357152 20003 tablet_replica.cc:331] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.357571 20003 raft_consensus.cc:2238] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.357926 20003 raft_consensus.cc:2267] T 36bf434726e740a1a55bb757ea6c7a04 P 4841879f5e4347918a29b974a7cadd49 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.359685 20003 tablet_replica.cc:331] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.360111 20003 raft_consensus.cc:2238] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.360889 20003 raft_consensus.cc:2267] T 8e2535f2645d4849b03aeeb84682f73e P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.362964 20003 tablet_replica.cc:331] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.363354 20003 raft_consensus.cc:2238] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.363773 20003 raft_consensus.cc:2267] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.365543 20003 tablet_replica.cc:331] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.366075 20003 raft_consensus.cc:2238] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.366472 20003 raft_consensus.cc:2267] T 3b36c529424042cca5930cbea746ee97 P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.368268 20003 tablet_replica.cc:331] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.368705 20003 raft_consensus.cc:2238] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.369429 20003 raft_consensus.cc:2267] T f741922802204b7f9899054395f6bedf P 4841879f5e4347918a29b974a7cadd49 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.371326 20003 tablet_replica.cc:331] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49: stopping tablet replica
I20250109 21:12:07.371771 20003 raft_consensus.cc:2238] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 3 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.372145 20003 raft_consensus.cc:2267] T c61207388546489497ba5192615f7ddc P 4841879f5e4347918a29b974a7cadd49 [term 3 FOLLOWER]: Raft consensus is shut down!
W20250109 21:12:07.397974 25020 consensus_peers.cc:487] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 -> Peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Couldn't send request to peer ef0ecd709a624128b4513100dfc72fc6. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:12:07.411500 20003 tablet_server.cc:195] TabletServer@127.19.136.194:0 shutdown complete.
I20250109 21:12:07.444628 20003 tablet_server.cc:178] TabletServer@127.19.136.195:0 shutting down...
I20250109 21:12:07.476766 20003 ts_tablet_manager.cc:1500] Shutting down tablet manager...
I20250109 21:12:07.477416 20003 tablet_replica.cc:331] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.478035 20003 raft_consensus.cc:2238] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.478863 20003 raft_consensus.cc:2267] T 5c7d315d074c4f8fa425b5e9a96e1f70 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.480819 20003 tablet_replica.cc:331] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.481391 20003 raft_consensus.cc:2238] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.481801 20003 raft_consensus.cc:2267] T 18e6733e937d466eb44925ad1601ba10 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.483708 20003 tablet_replica.cc:331] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.484241 20003 raft_consensus.cc:2238] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.484689 20003 raft_consensus.cc:2267] T ca9f7d9e7c60492dafa2eaf31ca18c7e P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.487028 20003 tablet_replica.cc:331] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.487610 20003 raft_consensus.cc:2238] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.488161 20003 raft_consensus.cc:2267] T 4e06275a29b34e0b9773456bfb5b5954 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
W20250109 21:12:07.489614 25020 consensus_peers.cc:487] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 -> Peer 4841879f5e4347918a29b974a7cadd49 (127.19.136.194:34007): Couldn't send request to peer 4841879f5e4347918a29b974a7cadd49. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.194:34007: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:12:07.490183 20003 tablet_replica.cc:331] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.490775 20003 raft_consensus.cc:2238] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.491483 20003 raft_consensus.cc:2267] T 5448fa51a40c48bdb4fc1bba783f069a P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.493691 20003 tablet_replica.cc:331] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.494166 20003 raft_consensus.cc:2238] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Raft consensus shutting down.
W20250109 21:12:07.494534 25020 consensus_peers.cc:487] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 -> Peer ef0ecd709a624128b4513100dfc72fc6 (127.19.136.193:46187): Couldn't send request to peer ef0ecd709a624128b4513100dfc72fc6. Status: Network error: Client connection negotiation failed: client connection to 127.19.136.193:46187: connect: Connection refused (error 111). This is attempt 1: this message will repeat every 5th retry.
I20250109 21:12:07.494657 20003 raft_consensus.cc:2267] T 6008039b2a714bada9232df36acf69ea P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.496666 20003 tablet_replica.cc:331] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.497128 20003 raft_consensus.cc:2238] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.497614 20003 raft_consensus.cc:2267] T 3db5be22d5e44289a4f05e0472013e31 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.499545 20003 tablet_replica.cc:331] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.500006 20003 raft_consensus.cc:2238] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.500382 20003 raft_consensus.cc:2267] T 8fe14f975aa84664bb0ed6080d7c89e4 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.502240 20003 tablet_replica.cc:331] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.502717 20003 raft_consensus.cc:2238] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.503472 20003 raft_consensus.cc:2267] T e7c28f7e01f64c90a201ea5904bb178f P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.505364 20003 tablet_replica.cc:331] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.505836 20003 raft_consensus.cc:2238] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.506279 20003 raft_consensus.cc:2267] T e210d085e81c4b1ab4e3f74ecac93cf8 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.508074 20003 tablet_replica.cc:331] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.508478 20003 raft_consensus.cc:2238] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.508822 20003 raft_consensus.cc:2267] T e2c33c211712430888fa872f1226d799 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.510511 20003 tablet_replica.cc:331] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.511006 20003 raft_consensus.cc:2238] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.511375 20003 raft_consensus.cc:2267] T b0708b4b9a5c43959b1b3d303115fad9 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.512969 20003 tablet_replica.cc:331] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.513360 20003 raft_consensus.cc:2238] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.514127 20003 raft_consensus.cc:2267] T 3b36c529424042cca5930cbea746ee97 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.515887 20003 tablet_replica.cc:331] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.516324 20003 raft_consensus.cc:2238] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.516863 20003 raft_consensus.cc:2267] T 36bf434726e740a1a55bb757ea6c7a04 P 5623262d5bc949f7907acb0a7215d9b4 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.518651 20003 tablet_replica.cc:331] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.519141 20003 raft_consensus.cc:2238] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.519497 20003 raft_consensus.cc:2267] T 4df8bcc17f3d4430b1eebf02c2e60c52 P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.521174 20003 tablet_replica.cc:331] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.521589 20003 raft_consensus.cc:2238] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.521976 20003 raft_consensus.cc:2267] T 8e2535f2645d4849b03aeeb84682f73e P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.523790 20003 tablet_replica.cc:331] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.524232 20003 raft_consensus.cc:2238] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus shutting down.
I20250109 21:12:07.524616 20003 raft_consensus.cc:2267] T f741922802204b7f9899054395f6bedf P 5623262d5bc949f7907acb0a7215d9b4 [term 2 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.526381 20003 tablet_replica.cc:331] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4: stopping tablet replica
I20250109 21:12:07.526780 20003 raft_consensus.cc:2238] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 3 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.527485 20003 raft_consensus.cc:2267] T c61207388546489497ba5192615f7ddc P 5623262d5bc949f7907acb0a7215d9b4 [term 3 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.564246 20003 tablet_server.cc:195] TabletServer@127.19.136.195:0 shutdown complete.
I20250109 21:12:07.596275 20003 master.cc:537] Master@127.19.136.254:38067 shutting down...
I20250109 21:12:07.615242 20003 raft_consensus.cc:2238] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 1 LEADER]: Raft consensus shutting down.
I20250109 21:12:07.615849 20003 raft_consensus.cc:2267] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7 [term 1 FOLLOWER]: Raft consensus is shut down!
I20250109 21:12:07.616144 20003 tablet_replica.cc:331] T 00000000000000000000000000000000 P 67307ee40f1a4b0690ae46dbd071f7c7: stopping tablet replica
I20250109 21:12:07.635883 20003 master.cc:559] Master@127.19.136.254:38067 shutdown complete.
[ OK ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/1 (20107 ms)
[----------] 2 tests from FilterSoftDeletedTableTest (43151 ms total)
[----------] Global test environment tear-down
[==========] 7 tests from 2 test suites ran. (184047 ms total)
[ PASSED ] 5 tests.
[ SKIPPED ] 1 test, listed below:
[ SKIPPED ] LeaderRebalancerTest.TestMaintenanceMode
[ FAILED ] 1 test, listed below:
[ FAILED ] FilterSoftDeletedTableTest.TestFilterSofteDeletedTable/0, where GetParam() = false
1 FAILED TEST
I20250109 21:12:07.686821 20003 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:220: suppressed but not reported on 2200 messages since previous log ~33 seconds ago
I20250109 21:12:07.687068 20003 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:304: suppressed but not reported on 2200 messages since previous log ~33 seconds ago
I20250109 21:12:07.687211 20003 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet_mm_ops.cc:139: suppressed but not reported on 2199 messages since previous log ~33 seconds ago
I20250109 21:12:07.687354 20003 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:594: suppressed but not reported on 44 messages since previous log ~62 seconds ago
I20250109 21:12:07.687481 20003 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tserver/ts_tablet_manager.cc:542: suppressed but not reported on 44 messages since previous log ~63 seconds ago
I20250109 21:12:07.687606 20003 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/master/catalog_manager.cc:4615: suppressed but not reported on 1 messages since previous log ~76 seconds ago
I20250109 21:12:07.687783 20003 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/rpc/proxy.cc:239: suppressed but not reported on 8 messages since previous log ~0 seconds ago
I20250109 21:12:07.688041 20003 logging.cc:424] LogThrottler /home/jenkins-slave/workspace/build_and_test_flaky@2/src/kudu/tablet/tablet.cc:2367: suppressed but not reported on 107 messages since previous log ~42 seconds ago